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Abstract 



This thesis addresses the question of stabihty of systems defined by differential equa- 
tions which contain nonhnearity and delay. In particular, we analyze the stability 
of a well-known delayed nonlinear implementation of a certain Internet congestion 
control protocol. We also describe a generalized methodology for proving stability of 
time-delay systems through the use of semidefinite programming. 

In Chapters m and we consider an Internet congestion control protocol based on 
the decentralized gradient projection algorithm. For a certain class of utility function, 
this algorithm was shown to be globally convergent for some sufficiently small value 
of a gain parameter. Later work gave an explicit bound on this gain for a linearized 
version of the system. This thesis proves that this bound also implies stability of the 
original system. The proof is constructed within a generalized passivity framework. 
The dynamics of the system are separated into a linear, delayed component and a 
system defined by a nonlinear differential equation with discontinuity in the dynamics. 
Frequency-domain analysis is performed on the linear component and time-domain 
analysis is performed on the nonlinear discontinuous system. 

In Chapter [7[ we describe a general methodology for proving stability of linear 
time-delay systems by computing solutions to an operator-theoretic version of the 
Lyapunov inequality via semidefinite programming. The result is stated in terms of 
a nested sequence of sufficient conditions which are of increasing accuracy. This ap- 
proach is generalized to the case of parametric uncertainty by considering parameter- 
dependent Lyapunov functionals. Numerical examples are given to demonstrate con- 
vergence of the algorithm. In Chapter |H1 this approach is generalized to nonlinear 
time-delay systems through the use of non-quadratic Lyapunov functionals. 
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Preface 



This thesis covers my work done in the Networked Systems and Controls Lab at 
Stanford University under the direction of Professor Sanjay Lall during the period 
from August of 2002 through January of 2006. With the exception of Chapter |S1 
almost all of the work presented here has been previously published or submitted to 
peer-reviewed academic journals or conferences. The chapters of this thesis can be 
divided into those containing original research and those containing an overview of 
existing results. Specifically, Chapters El 13 and |H1 contain original results, while most 
of the rest of the chapters can be considered as survey material. 

Some attempt has been made in this thesis to keep the length of the chapters 
minimal in order to improve readability. The presentation style is mathematically 
oriented, with specifics of numerical implementation suppressed. Proofs, when espe- 
cially long, have been moved to the appendices. To maintain focus on the theoretical 
contribution, in-depth treatment of various special cases has been omitted when such 
treatment can be inferred from previous exposition. 
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Chapter 1 



Introduction 



1.1 Research Goals 

The analysis of nonlinear systems is a subject of much recent interest. Although 
linearization is a well-established approach to analysis, results obtained in this man- 
ner are always, at best, local. When considering changes in critical systems such as 
the Internet, the guarantee of convergence associated with a global stability result 
carries significant weight. Furthermore, some dynamical systems, such as are found 
in biology or high performance aircraft, are dominated by nonlinear behavior. In 
such cases, the practical value of linear analysis is limited. Apart from nonlinearity, 
the study of decentralized systems and systems with delay is also the topic of much 
active research. Communications systems, an issue of significant current interest, are 
often decentralized and, by virtue of their geographic reach, inevitably contain delay. 
Earth based telescopes are currently being built which consist of thousands of mirror 
segments; each individually actuated but required to move in a coordinated manner. 
Such systems are difficult to model using a state space of reasonable dimension. 

The recent development of efficient algorithms for optimization on the cone of 

positive semidcfinitc matrices has created a fundamental shift in how research is con- 
ducted. Specifically, semidefinite programming has been widely adopted in control 



1 



2 



CHAPTER 1. INTRODUCTION 



theory and has led to a greater understanding of hnear finite dimensional central- 
ized systems. Unfortunately, this same understanding has not yet been extended to 
nonlinear, infinite dimensional or decentralized systems. In fact, many critical ques- 
tions in analysis and control of these systems have been shown to be NP-hard. The 
goal of our research at Stanford has been to find new ways to address these types of 
problems. One approach is to expand the definition of solution. Instead of giving a 
single necessary and sufficient condition, expressible as a semidefinite program, one 
can construct a nested sequence of sufficient conditions, of increasing accuracy, which 
converge to a necessary and sufficient condition and are expressible as semidefinite 
programs. Examples of this technique as well as others can be found in the chapters 
of this thesis. 



Internet Congestion Control The application which has motivated much of the 
research in this thesis has been stability analysis of proposed protocols for Internet 
congestion control. The analysis of congestion control protocols has received much 
attention recently. This work has been motivated by concern about the ability of 
current protocols to ensure stability and performance as the number of users and 
amount of bandwidth continues to increase. Although the protocols that have been 
used in the past have performed well as the Internet has increased in size, as capac- 
ities and delays increase instability will become a problem. In our work, we have 
considered global stability with delay of congestion control protocols which attempt 
to solve a distributed network optimization problem. These systems are described by 
differential equations with delay and contain non-static nonlinearity. Because of the 
nonlinearity and delays, proving convergence is difficult. By combining frequency and 
time domain techniques using a generalized passivity framework, in Chapters 0] and 
we have shown for certain protocols that global stability with delay holds under the 
same conditions as local stability. Condensed versions of these results also appear in 
publication in [23] and [32]. These tight bounds, verified by experimental evidence, 
allow one to accurately predict when congestion control will fail. 
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An Approach to Analysis and Synthesis Our research at Stanford has produced 
a number of new resuhs and tools concerning the analysis of systems with delay, non- 
linearity and decentralized structure. Specifically, in Chapter [7| we have proposed 
two new types of refutation which can be used to construct the positive quadratic 
Lyapunov-Krasovskii functionals necessary for stability of linear time-delay systems. 
Furthermore, we have shown how these refutations can be parameterized using the 
space of positive semidefinite matrices. This has resulted in a nested sequence of 
sufficient conditions, of increasing accuracy and expressible as semidefinite programs, 
which prove stability of linear time-delay systems. Thus for any desired level of ac- 
curacy, these results give a condition, expressible as a semidefinite program, which 
will test stability to that level of accuracy. These results appear in publication in [HT] 
and jHHl- In addition, because of the structure of the refutations, in Chapter |Hlwe have 
also been able to generalize these results to time-delay systems with nonlinearities. 
Some of these results appear in publication in . 



1.2 Prior Work 

The contents of this thesis utilize results from a number of different areas of research. 
A complete survey of the results in any one of these fields would be beyond the scope 
of this document. In this section we briefiy list some landmark contributions which 
have directly infiuenced the direction of our research. 

Stability Theory Early results include the work of the Russian mathematician A. 
M. Lyapunov j2H], who, in 1892, standardized the definition of stability and gener- 
alized the potential energy work of Lagrange to systems of ordinary differential 
equations of the form x{t) = f{x{t)). In the century that has followed, the use of 
Lyapunov functions to prove stability has become commonplace and is known alter- 
natively as the "Direct method of Lyapunov" or "Lyapunov's second method". 

In the 1960's, the input-output approach to stability analysis emerged as an al- 
ternative to Lyapunov's method. This approach was motivated by the development 



4 



CHAPTER 1. INTRODUCTION 



of complicated electronic systems for which a detailed analysis of the stability of the 
internal states was impractical. The work was pioneered by Sandberg |52l and 
Zames jH2l ES] and can be found in such works as [IH] and p. The input-output 
framework was of practical importance for a number of primary reasons. First, it 
could be used with "black-box" frequency sweeping techniques to quickly determine 
properties of complicated linear systems even when those systems contained internal 
delay. In addition, these frequency- domain properties could then be used to predict 
the stability of the interconnection of systems through the use of concepts such as 
passivity and small-gain. Development of the input-output framework has had some 
relatively recent advances with the introduction of the theory of "Integral Quadratic 
Constraints" (IQCs) by Rantzer and Megretskii j^Uj. This work on IQCs generalizes 
the passivity framework by formulating stability conditions which allow for the use of 
a broad class of multipliers. This work will be discussed in more depth in Chapter El 

Semidefinite Programming The first stability problem to be posed as a linear 
matrix inequality(LMI) can be attributed to Lyapunov himself, who stated that the 
system 

x{t) = Ax{t) 

is stable if and only if there exists a P > such that 

A'^P + PA<0. 

Of course, in the absence of algorithms for this LMI, Lyapunov was forced to express 
this conditional analytically as the unique solution, P, for arbitrary Q > 0, of the 
Lyapunov equation A^P + PA = —Q. The solution of LMIs arising in control theory 
through the use of analytical solutions was continued in the 1940's and 1950's by the 
work of Lur'e, Postnikov, and others in the Soviet Union. 

The first general method for the solution of LMIs was developed in the 1960's by 
Kalman, Yakubovich, and others. The famous positive-real or KYP lemma showed 
that a certain class of LMI problems could be solved graphically by considering a 
frequency domain inequality. Today, of course, the KYP lemma is used more often 
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in the opposite sense, i.e. to convert a frequency-domain inequality to a semidcfinite 
program. The LMI associated with the KYP lemma was later shown to admit an 
analytic solution through use of the algebraic Riccati equation (ARE). 

The most significant advance in the solution of LMI problems was the recognition 
in the 1970's that many LMIs could be expressed as convex optimization problems 
which could be solved using recently developed efficient numerical algorithms for 
linear programming. Thus the use of analytic solutions to LMI problems was replaced 
by semidefinite programming which is defined as optimization over the convex cone 
of positive semidefinite matrices. 

The algorithms for numerical optimization which were first used to solve LMI 
problems were originally developed to solve linear programming problems of the fol- 
lowing form where the inequality is defined by the positive orthant. 

max c^y : 
Ay<b 

The solution of linear programming problems was first addressed by the devel- 
opment of the Simplex algorithm by G. Dantzig in the mid-40's. This algorithm 
performed well when applied to most problems but was shown to fail in certain 
special cases. Concern about this "worst-case" complexity prompted the search for 
what we now refer to as polynomial-time algorithms, which have provable bounds on 
worst-case performance. The first such polynomial-time algorithm was introduced 
by Khachiyan in 1979 and is referred to as the eUipsoid algorithm. This algorithm, 
however, proved inferior to the Simplex algorithm in most practical cases. The first 
major improvement over the Simplex algorithm was developed in 1984, when N. Kar- 
makar proposed a new type of algorithm which used what we now refer to as an 
"interior-point" method. This algorithm was also of polynomial-time complexity but 
performed far better than the ellipsoid algorithm in practice. The final hurdle towards 
numerical solution of LMI problems was overcome in 1988, when Nesterov and Ne- 
mirovskii developed interior point algorithms which applied directly to semidefinite 
programming problems. Today, semidefinite programming programs can be solved 
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simply and efficiently using interior-point solvers such as SeDuMi combined with 
user-friendly interfaces such as Yalmip. A summary of standard LMI problems in 
control theory can be found in the seminal work by Boyd et al. j^. 

Recently, the success of semidefinite programming in addressing problems in con- 
trol has led to research into whether these algorithms can be applied to convex prob- 
lems in polynomial optimization. Polynomial optimization problems arise in many 
areas of nonlinear systems analysis and control and this topic will be covered in 
significant depth in Chapter IHl 

Internet Congestion Control The origins of research interest in Internet conges- 
tion control from a mathematical perspective can be traced back to the the paper by 
Kelly et al. wherein the the congestion control problem was first cast as a de- 
centralized optimization problem. This paper showed that certain congestion control 
protocols would converge to the global optimum in the absence of delay through the 
use of a Lyapunov argument. Subsequently, in Low and Lapsley j2S|; it was shown 
that the dynamics of the delayed Internet model with a certain class of control algo- 
rithms could be interpreted as a decentralized implementation of the asynchronous 
gradient projection algorithm to solve the dual to the network optimization problem 
thus showing global convergence to optimality for sufficiently small step size. How- 
ever, no global bound for the step size was given in this paper, making practical 
interpretation difficult. This work was followed by the paper by Paganini et al. |29j . 
wherein it was shown that with a certain set of pricing functions, a uniform bound of 
a < 7r/2 on a certain gain parameter a at the source allows a proof of local stability 
for arbitrary topology and heterogeneous time delays. This work was similar in many 
respects to work by Vinnicombe jlHI for a different network implementation. Our own 
work has shown this uniform bound of a < 7r/2 was shown to imply global stability 
for heterogeneous time delays in a more limited topology in ^35, and [32] • AH these 
results are discussed in more depth in Chapters El and El 

Time-Delay Systems In 1963, the potential energy methods of Lagrange and 
Lyapunov were generalized to systems of functional differential equations by N. N. 
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Krasovskii [201 ■ Since this time, many computationally tractable sufficient conditions 
have been given for stability of both linear and nonlinear time-delay systems, all 
with varying degrees of conservatism. An overview of some of these results can be 
obtained from survey materials such as are found in ^3 CSl I2H] ■ These results 
can be grouped into analysis either in the frequency-domain or in the time-domain. 
Frequency-domain techniques can be applied to linear systems only and typically at- 
tempt to determine whether all roots of the characteristic equation of the system lie 
in the left half-plane. This approach is complicated by the transcendental nature of 
the characteristic equation, which imply the existence of a possibly infinite number 
of roots. Time-domain techniques generally use Lyapunov-based analysis. In the lin- 
ear case, the Lyapunov approach benefits from the existence of an operator-theoretic 
version of Lyapunov's inequality, the existence of a positive solution to which is neces- 
sary and sufficient for stability. Computing solutions to this inequality, however, has 
historically been problematic. A main contribution of this thesis is to show how the 
operator-theoretic Lyapunov equation can be solved directly using semidefinite pro- 
gramming. This work is described in Chapter [7| and the references jSZ] and [SH] . We 
note that one attempt to solve the Lyapunov equation by considering piecewise-linear 
functions was made in a series of papers by Gu et al. and is summarized in [TH] . 

1.3 Notation 

The following are used throughout this thesis. 

Vector Spaces In this thesis, we use the following standard notation. M"^"* denotes 
the space of real nxm matrices. S" denotes the space of symmetric nxn matrices. Let 
M"*" :={xGM|x>0}. Let C{I) denote the set of continuous functions u : I ^ R"" 
where J C M. We say / G C(/) is hounded if there exists some h G M~*" such that 
||/(^)||2 < b for all 9 E I. We use Cr to denote the Banach space of continuous 
functions u G C([— r, 0]) with norm = sup4gj_^o] ll'"(^)l|2- 

Definition 1. For a given t > 0, x E C([a, b)), and t G [a + r, 6], where h > a + t, 
define Xt G Cr by XtiO) = x(t + 6) for 9 G [— r, 0] . 
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L2(— cxo, cxd) is the Hilbert space of Lebesgue measurable real vector-valued func- 
tions X : M — s> with inner-product {u, v)2 = u{t)^v{t)dt. L2 denotes L2[0, 00) — 
{ a; e L2(— 00, cxo) | x(t) = for alH < } and is a Hilbert subspace of L2(— 00, 00). 
Similarly, L2[a, b] denotes the restriction of L2(— 00, 00) to the interval [a, b]. Through- 
out, the dimensions of x{t) for x & L2 should be clear from context and are not 
explicitly stated. We will occasionally also associate with Cr an inner product space 
equipped with the inner product associated with L2. Thus for x,y e Ct, {x,y) 
denotes the L2 inner product. L2 denotes the Hilbert space of complex vector- 
valued functions on the imaginary axis, x : jM. — > C" with inner-product {u,v)2 — 
^ jT^'^{j'^)*'^{j'^)doJ ■ Loo denotes the Banach space of matrix-valued functions on 
the imaginary axis, G : jM — > C"*^" with norm ||G||oo = ess sup^^gjj {^{ju)^ where 
a{G{iuii)) denotes the maximum singular value of G'(jcc;). For a given r > 0, let M2 
denote the product space x I/2[— t, 0] endowed with the inner product 

{x,y) := xlvi + {X2,y2)2, 
where we associate with x e M2 a pair {xi, X2) where xi e R" and X2 G L2[—t, 0]. 



Maps and Operators An operator A on an inner-product space is defined to be 
positive on a subset X ii {x, Ax) > for all x e X. A function x : R — > R is said 
to be absolutely continuous if for any integer N and any sequence ti, . . . ,tN, we 
have \x(tk) —x(tk+i)\ whenever X^^IT/ |^fc~^fc+i| ~^ 0. Pt is the truncation 

operator such that ii y = PtZ, then y(t) = z{t) for all t < T and y{t) = otherwise. 
L2e denotes the space of functions such that for any T > and y G L2e, we have 
Pry G L2. We also make use of the space W2 := {y E L2 : y & L2} with inner 
product {x,y)w2 = {x,y)L2 + {x,y)L2 and extended space W2e '■= {y G L2e '■ y G L2e}- 
A causal operator H : L2e —>■ L2e is bounded if H{0) = and if it has finite gain, 
defined as 

||ii|| = sup .. .. 

uGL2^0 \\u\\ 

u denotes the cither the Fourier or Laplace transform of -u, depending on u. We 
will also make use of the following specialized set of transfer functions which define 
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bounded linear operators on L2. A is defined to be those transfer functions which are 
the Laplace transform of functions of the form 



where /i e Li, e M and ti > 0. 

Real Algebraic Geometry Denote by M.[x] the ring of scalar polynomials in vari- 
ables X. Denote by R"^™[a;] the set of n by m matrices with scalar elements in M.[x]. 
Let §"[a;] denote the set of symmetric n by n matrices with elements in R[x] and 
define E>2[x] to be the elements of S'^[x] of degree d or less. Let C M.[x] denote 
the convex cone of scalar polynomials which are non-negative on Y. Let C R[x] 
denote the convex cone of globally non-negative scalar polynomials. Let denote 
the convex cone of elements M e such that M{x) > for all x E Y. Let 

denote the convex cone of elements M e such that M{x) > for all x. We let 
Zd[x] denote the ("^'^) -dimensional vector of monomials in variables x e of degree 
d or less. Define Z^lx] :— In (8) Zd[x], where is the identity matrix in and is 
the Kronecker product. Finally, we note that for the sake of notational convenience, 
we will often use the expression M{x) e X to indicate that the function M e X 
for some set of functions X. This will hopefully not cause substantial amounts of 
confusion. 
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Functional Differential Equations 



2.1 Introduction 



The best way to introduce the concept of a functional differential equation is through 
the use of an example. 

Example 1: Perhaps the most easily understood example of a system defined by a 
functional differential equation is that of the dynamics of taking a shower. Specifically, 
define ST{t) to be the difference between water temperature and body temperature 
at time t. We assume that the typical bather controls the water temperature by 
turning the hot- water knob at rate uj{t), proportional to the difference between water 
temperature and body temperature so that u!{t) = —aST{t). Ideally, the position of 
the hot water knob is directly proportional to the temperature of the water coming 
from the head, ST{t) = j3uj{t) for /3 > 0. In this case, we have the following ordinary 
differential equation. 



5f{i) = auj{t) = -apST{t) 

This is a linear, time-invariant system and consequently we know that limt_>oo ST{t) — 
for any any initial condition ST{0) and any positive value of a. However, as most 
people know, there is occasionally a delay between action on the hot-water knob and 
change of temperature at the head. This delay occurs because hot water mixed at 
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the knob must pass through a length of pipe before arrival at the shower head. We 
assume that the delay, r, is constant and can be calculated as t = L/v; where L is 
the linear distance from the tap to the head and v is the rate of the water flowing in 
the pipe. The simplest description of the delayed system is given as follows. 

Sf{t) = -a(3ST{t - r) 

It can be shown ^3] that a system of this form is stable in the region af3 G 
(0, ^) and unstable outside of this region. Thus we conclude that in the presence of 
delay, any bather will get scalded if sufficiently impatient. The reason that a large 
proportional feedback gain fails in the shower example is that the temperature of the 
water at the head does not provide an adequate representation of the state of the 
system. In order to exactly predict exactly how the water temperature will evolve 
over time, one needs to know the water temperature, T{6,t), at every point 6 in the 
pipe from the knob to the head for some time t. This information precisely defines 
the state of the system at time t. Because the state at time t, T{-,t) is a function, 
the dynamics of a shower are defined by a function of a function or a functional. 

In fact, the dynamics given above represent a simplification of the more difficult 
problem of fiuid fiow described by partial differential equations. We are able to rep- 
resent the system using such a simple model only because the controller and observer 
are highly structured so that control and observation take place only at discrete points 
in the flow. Such simplifled models are quite common and are collectively known as 
time-delay systems. 

2.2 Definitions and the Concept of State 

To begin, we deflne the following. 

Definition 2. Suppose we are given a t > and map f : Cr x IR^ M". We say 
that a function x G C([— r, 6)) is a solution on [— t, 6) to the functional differential 
equation defined by f with initial condition Xq & Cr if x is differentiahle, x{9) = Xq{6) 
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for 9 G [— r, 0] and the following holds for t > 0. 



x{t) = f{xt,t) 



(2.1) 



In this thesis, we make use of two different concepts of state space. The first, 
and perhaps the most common is the Banach space Cr, equipped with the supremum 
norm. In this scenario, the state of the system is simply the trajectory of the system 
over the past r seconds of time. It is in this space that we will define solution maps 
and theorems of existence and uniqueness. An example of such a state is illustrated 
in Figure ITTl 



Another concept of state space which we find more satisfying for applications such 
as stability is the space M2, which was thoroughly investigated by such work as that 
by Delfour and Mitter |8 . For solution x, the state of the system, at time t is 
defined as (f){t) = {x(t),xt). (p lies in the subspace H2 C M2 defined as follows. 



This space better reflects the dependency of the system on both the finite di- 
mensional element x{t) as well as the hereditary infinite dimensional element Xt. In 
addition, use of this state space allows us to embed the state space within the Hilbert 




Figure 2.1: An illustration of the state Xt G Cr 



H2 



{y G M2 : 1/2 e Cr, yi = 2/2(0)} 
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space M2, a feature useful in describing the operators used to define Lyapunov sta- 
bility criteria. 

Definition 3. For a given functional, f : Ct xM"^ — > M", suppose that for any e Cr, 
there exists a unique solution on [— r, 00) to the functional differential equation defined 
by f. Define the solution map Gf : Ct ^ ^)) by y — Gf{(f)) where y is the 

solution to the functional differential equation defined by f with initial condition 0. 

For the time-invariant case, where f{xt,t) = f{xt), we define the following, which 
maps the evolution of the state. 

Definition 4. For a given solution map, Gf, define the flow map Tf : CrX M"*" Cr 
byi^ Tf{(j),At) ifi^ yAt where y = Gf{(j)). 

The solution map, Gf, and flow map, Tf, provide convenient notation for express- 
ing the evolution of the system over time. The following result gives conditions under 
which the solution map is well-defined in the time-varying case. 

2.2.1 A Note on Existence of Solutions 

In this subsection, we give a theorem which provides conditions for the existence and 
uniqueness of solutions defined on C([— r, 00)). 

Theorem 5. Suppose a functional f : Cr x IR"^ — > satisfies the following. 

• There exists a Ki > such that 

\\f{x, t) - fiy, t)\\2 < K, \\x - y\\c^ for all x,yECr,t>0 

• There exists a K2 > such that 

11/(0, t) II <K2 forallt>0 

• f{x,t) is jointly continuous in x and t. i.e. for every {x,t) and e > 0, there 
exists a rj > such that 

Ik - y\\cr + 11^ - s|| < ^ ^ \\f{x, t) - f{y, s)\\ < e. 
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Then for any G Cr, there exists a unique x G C[— r, oo) such that x is differentiable 
for t > 0, x{t) = (j){t) for t G [-r, 0] and 

x{t) = f{xt,t) forallt>0 

See Appendix 1X1 for Proof. 

By use of Theorem, 13 we can show that if a functional, /, satisfies a global Lips- 
chitz continuity condition, then for any initial condition there exists a unique solution 
to the functional differential equation defined by / which is defined on [— r, oo). In this 
case the solution map and, in the time-invariant case, the flow map are well-defined. 



2.3 Concepts of Stability 

In this section we define stability of a functional differential equation. 
2.3.1 Internal Stability 

Two concepts of stability will be used in this thesis. The first, internal stability, 
defines stability as a property of solutions of a functional differential equation for 
arbitrary initial conditions. The second, input-output stability, is used to define 
stability of an operator and describes the relationship between inputs and outputs. 
In this subsection we give a definition of internal stability. 

Definition 6. Assume that f satisfies f{0,t) = 0. The solution map Gf, defined by 
f , is stable on X C Cr if 

(i) GfX is bounded for any x G X 

(a) Gf is continuous at with respect to the supremum norm on C([— r, oo)) and 

Cr. 

This is the usual notion of Lyapunov stability, which states that for all e > there 
exists 6 > such that \\y\\ < 6 implies HG/yll < s. 
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Definition 7. The solution map Gf defined by f is asymptotically stable on 

X G Cr if it is stable on X and y = GfXQ implies liiiif^oo y{t) = ^ for any xq G X . 

Definition 8. The solution map, Gf, is globally stable if it is stable on Cr 

Definition 9. The solution map, Gf, is globally asymptotically stable if it is 

asymptotically stable on Cr- 

Note: For a system defined by a linear functional, global stability is equivalent 
to stability on any open neighborhood of the origin. See, for example [T^ I19j. 

2.3.2 Input-Output stability 

We can associate with a functional, /, an input-output system. 

Definition 10. For functional f and function g, let y = f,gU if y{t) = g{x{t)) for 
t e R"*" where x = Gj{0) and 

f{Xt,t) = f{xt,t)+u{t). 

We can now define input-output stability directly in terms of properties of the 
operator \E'. 

Definition 11. For normed spaces X, Y , the operator "^isY stable on X if it defines 
a single-valued map from X to Y and there exists some P such that W'^uWy < /^ll'^llx 
for all M G X. 

Note: We refer to X stability on X as simply X stability. 

2.4 Time-Delay Systems 

So far, we have only considered the general case of a dynamic system defined by 
a functional. In this section, we identify a specific class of functional differential 
equation which will be of particular importance throughout this thesis. 
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Definition 12. We say that a functional, f, defines a Time-Delay System if f 

can be represented using a function the following way where 

Ti > Ti_i for i = 1, . . . ,K and Tq = 0. 

f{Xt)= / p{Xt{-To),Xt{-Ti),- ■ ■ ,Xt{-TK),Xt{9),e)de 

J-TK 



Stability of Time-Delay systems are generally classified using the following defini- 
tions. 

Definition 13. A Time-Delay System is Delay- Independent Stable if it is stable 
for arbitrary Tj G M for i = 1 . . . K . 

Definition 14. A Time-Delay System is Delay- Dependent Stable on X if it is 

stable for G Xj for i = 1 . . . K where the Xi are compact subsets o/M. 

2.4.1 The Case of Linear Time-Delay Systems 

In this subsection, we consider the special case of linear time-delay systems. Specif- 
ically, we consider functionals which can be expressed in the following form, where 
Ti > rj_i for i = 1, . . . , and tq = 0. 

f{xt) = J2 "^Mt A{e)x{t + e)de (2.2) 

Here A^ G M"""" and A : M ^ M"^" is bounded on [-tk, 0]. The following lemma, 
combined with Theorem El shows that elements of this class of system admit a unique 
solution for every initial condition xq G Crj^. 

Lemma 15. Let 



f{x,t) :='^Aix{t-Ti) + / A{9)x{t + 9)d9 

i=l -'-■^K 
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Where A{6) is bounded on [—Tk, 0]. Then there exists some k > such that 

\\f(x,t)-fiy,t)h<k\\x~y\\c^ 
See appendix for Proof. 

By using Lemma El we can associate with linear systems of this form a well- 
defined solution map Gf and flow map Tf. 



2.5 Conclusion 

In this chapter, we have introduced various concepts associated with functional dif- 
ferential equations. These concepts include the state of the system, the solution map 
and stability in both the internal and input-output framework. We will make use of 
these definitions throughout the remainder of this thesis. 



Chapter 3 



Stability of Functional Differential 
Equations 

In this chapter, we introduce two methods of proving stabihty of functional differ- 
ential equations. The first, which can be used to prove internal stability, uses a 
generalization of Lyapunov theory to functional differential equations. The second 
method, which is used to prove input-output stability, is a generalization of the notion 
of passivity. 

3.1 The Direct Method of Lyapunov 

Consider a solution map Gf defined by a functional /. We consider the state of the 
system at time t to be defined by an element Xt E Cr- Standard Lyapunov theory, 
however, is defined using functions of the form V{x{t)). Such functions capture 
only part of the energy of the state, Xt, i.e. that part stored in Xt{0). Therefore, 
any stability condition derived from such functions will be inherently conservative. 
An attempt to address this conservatism was made by Krasovskii [20J through the 
introduction of Lyapunov functionals which depend on elements of Cr- 

Definition 16. Let V : Cr ^ ^ be a continuous function such that V{0) = 0. For a 
given flow map, Tf, defined by solution map, Gf, define the upper Lie derivative ofV 
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as follows. 

V{(P) := limsup ^[V(r;(0, h)) - 

The following theorem follows from Gu 13] . 

Theorem 17. Let Q G Cr contain an open neighborhood of the origin. Let f : Q —>■ 
be continuous and take bounded sets of Q into bounded sets o/M". Let V : Cr —>■ ^ 
be a continuous map such that V{0) = 0. Let u,v,w : M'^ M"*" be continuous non- 
decreasing functions such that u{s), v{s) > for s ^ and u{0) = v{0) = 0. Suppose 
that the following holds for any G fi. 

u{\\m\\)<v{<p)<vm) 

V{<P) < -^(10(0)1) 

Then the solution map, Gf, defined by f is stable on some open neighborhood of the 
origin. If w{s) > for s > 0, then the system is asymptotically stable on some 
open neighborhood of the origin. If Q = Cr and lim^^oo = oo, then Gf is globally 
asymptotically stable. 

3.1.1 Complete Quadratic Lyapunov Functionals 

There have been a number of results concerning necessary and sufficient conditions 
for stability of linear time-delay systems in terms of the existence of quadratic func- 
tionals. These results are significant in that they allow us to restrict our search for 
a Lyapunov-Krasovskii functional to a specific class without introducing any conser- 
vatism. Consider a linear functional of the following form. 

/(xi) = J]A,x(t-ri)+ / A{9)xit + e)d9 (3.1) 

We now make the additional assumption that A is continuous on [— ri^,0]. The 
following comes from Gu et al. [T^ . 

Definition 18. We say that a functional V : Cr ^ is of the complete quadratic 
type if there exists a matrix P G S" and matrix-valued functions Q : ^ R"^", 



20 CHAPTER 3. STABILITY OF FUNCTIONAL DIFFERENTIAL EQUATIONS 

S : R ^ S"" and R : ^ R"^" where R{B,r]) = R{r],e)^ such that the following 



Theorem 19. Suppose the system defined by a linear functional of the form (jH.lj) is 
asymptotically stable. Then there exists a complete quadratic functional V and rj > 
such that the following holds for all (p & Cr- 



Furthermore, the matrix-valued functions which define V can be taken to be continuous 
everywhere except possibly at points 0,ri = —Ti for i = 1, . . . , K — 1. 

3.2 The Method of Integral Quadratic Contraints 

The theory of integral quadratic constraints(IQCs) is a method of proving stabihty 
of the interconnection of stable operators. 

3.2.1 Theory of Integral-Quadratic Constraints 

Consider the following interconnection of operators. 

Definition 20. Let G be a linear operator with transfer function G & A and let the 
operator A : L2 — > -^2 be causal and bounded. Define inputs f G W2 and (7 G L2. The 
interconnection of G and A, denoted ^f,g, is defined by {y,u) = ^{f,g) where y 
and u are defined as follows. 



holds. 




V{ct>)>ii\\m\? and V{ct>)<-r^\\m\? 



y = Gu + f 



u = Ay + g 
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Figure 3.1: Interconnection of systems 



Definition 21 (Jonsson [16j, p71). The interconnection of G and A, $g.A; 
well-posed if for every pair {f,g) with f G W2 and g G L2, there exists a solution 
u G L2e, y G W2e and the map {f,g) — > {y,u) is causal. 

If the interconnection of A and G is well posed, then the interconnection defines 
an operator $g,a : W2 x L2 — x L2e. In this thesis, we use a result by Rantzer 
and Megretski |1U] which can be interpreted as generalization of the classical notion 
of passivity. Recall the the following classical passivity theorem from e.g. Desoer and 
Vidyasagar(p. 182, 0) 

Theorem 22. The interconnection of A and G is L2 stable on L2 if there exists some 
e > such that for any x G -L2, 



Now given bounded linear transformations Hi, 112, define the following functional 



(Ax, a;) > 
{x,Gx) < -e\\x\\ 




Ignoring technical details for the moment, the result by Rantzer and Megretski 
states that the interconnection of A and G is stable if there exists an e > such that 
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for any x E L2, 



(a;, Ax)n > 
{Gx, x)n < — e||x| 



This idea of generalized passivity is motivated from a geometric standpoint by the 
topological separation argument, introduced by Safonov WP. Consider the following 
definition of an operator graph. 

Definition 23. For an operator, p : X ^ X , the graph of p is the set $(p) : = 
{{x,y) :y = p{x),x G X}. The inverse graph of p is the set $j(p) = {{x,y) : x = 
piy),ye X}. 
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Figure 3.2: Separating functions prove separation of graphs gi and (72 

Two graphs are separate if they intersect only at the origin. Consider graphs 
Qi and g2. If, for some functional a : X ^ M. and e > 0, we have cr{x) > for 
all X E gi and a{y) < —€\\y\\ for all y G (72, then the graphs gi and g2 can only 
intersect at the origin and are said to be separated by the functional a. Now consider 
the interconnection of operators G and A when we let the input g = 0. We have 
the equation f = {I — GA)y. The question of L2 stability becomes the question of 
existence of a well-defined and bounded inverse of (/ — GA) on L2. Now suppose 
there exists a nonzero y E L2 such that f = {I — GA)y = 0, then (/ — GA) has a 
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nontrivial kernel and thus can not have a bounded inverse. To ensure that (/ — GA) 
has a trivial kernel, we will consider the graph of G and the inverse graph of A. The 
following well-known result shows that separation of the graph and inverse graph of 
interconnected operators is necessary for stability. 

Theorem 24. Let f = {I — GA)y. The following are equivalent 

• {I-GA)y = =^ y = 

• ^G) n <l>i(A) = 

Proof. (<^) If there exists a y ^ such that (/ — GA)y = then let x = Ay. Thus 

X 

Gx 

(^) If there exists y,x such that 



X 




'Ay 


Gx 







then (/ - GA)y = y- GAy = Gx - GAy = GAy - GAy = ■ 

Although the separation of graphs is clearly necessary for most definitions of sta- 
bility, it is unclear under what additional conditions separation may also be sufficient 
for L2 stability. The result by Rantzer and Megretiski gives a particular class of 
functionals for which graph separation is sufficient for stability on L2. Many classical 
theorems concerning the stability of the interconnection of operators can be viewed 
as proving the separation of graphs and inverse graphs by using these type of sepa- 
rating functionals. For example, the small gain theorem can be expressed using the 
separating functional a{{x,y)) = \\x\\ — k\\y\\ for some A; > 0. Similarly, classical 
passivity can be expressed using the functional a{{x,y)) = {x,y). The complete class 
of functionals shown by to be sufficient for L2 stability is given by Definition |2S1 

Definition 25 (Rantzer [40j). The mapping a : L2 M. is quadratically con- 
tinuous if for every 5 > 0, there exists a rjs such that the following holds for all 





Ay 




y 



e $(G)n<l>,(A) 



24 CHAPTER 3. STABILITY OF FUNCTIONAL DIFFERENTIAL EQUATIONS 



Xi,X2 E L2. 



\a{xi) - cr{x2)\ < rjsWxi - + 6\\x2\ 



This class includes the small gain and passivity functions. Furthermore, for any 
bounded linear transformations 111,112, the function a{w) = {Iliw,Il2w) is quadrat- 
ically continuous. In this thesis we use the following generalization of the work by 
Rantzer and Megretski as presented in the thesis work by Jonsson P^ . 

Definition 26. Let Ub '■ jM — > £^nxn ^ hounded and measurable function that takes 
Hermitian values and A G M. We say that A satisfies the IQC defined by Ub, A, 
if there exists a positive constant 7 such that for all y G W2 and v = Ay G L2, 



1 

2^ 



v{juj) 



v{juj) 



duj + 2{v,\y)>~^\yi0)\' 



Theorem 27. Assume that 

1. G is a linear causal bounded operator with sG{s),G{s) G A 

2. For all n G [0, 1], the interconnection of nA and G is well-posed 

3. For all n G [0, 1], kA satisfies the IQC defined by Ub, X 
4- There exists 77 > such that for all u eM. 







" Xjuj* 


) 




I 


Xjuj 




I 



Then the interconnection of G and A is W2 x L2 stable on W2 x L2. 



3.3. CONCLUSION 
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3.3 Conclusion 

In this chapter, we have introduced methods of constructing proofs for internal and 
input-output stabihty. In the rest of this thesis, we shall show how these methods 
can be applied to prove stability of different kinds of time-delay systems. 



Chapter 4 



Internet Congestion Control 



4.1 Introduction 

The analysis of Internet congestion control protocols has received much attention 
recently. Explicit mathematical modeling of the Internet has allowed analysis of ex- 
isting protocols from a number of different theoretical perspectives and has generated 
some suggestions for improvement. This work has been motivated by concern about 
the ability of current protocols to ensure stability and performance of the Internet 
as the number of users and amount of bandwidth continues to increase. Although 
the protocols that have been used in the past have performed remarkably well as the 
Internet has increased in size, analysis [22] indicates that as capacities and delays 
increase, instability will become a problem. 

The purpose of this chapter is to outline the development of a mathematical the- 
ory of Internet congestion control. Most of the recent research activity in Internet 
congestion control protocols can be traced back to the the paper by Kelly et al. |,18] . 
wherein the the congestion control problem was first cast as a decentralized optimiza- 
tion problem. Subsequently, in Low and Lapsley it was shown that the dynamics 
of the Internet with a certain class of control algorithms could be interpreted as a 
decentralized implementation of the gradient projection algorithm to solve the dual 
to the network optimization problem, thus showing global convergence to optimality 
for sufficiently small step size. Finally, in Paganini et al. [23 it was shown that for a 
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certain set of utility functions, a global bound of a < 7r/2 on a certain parameter a at 
the source allows a proof of local stability for arbitrary topology and heterogeneous 
time delays. These fundamental results will form the background for our own work in 
Chapter wherein we show that the parameter bound of Paganini et al. guarantees 
global stability of the nonlinear implementation. 



4.2 The Internet Optimization Problem 



X y 

_!_ 



Sources ZLl Links 



r 

q 



Figure 4.1: The Internet is modeled as a collection of sources and links 



We view the Internet as an abstract collection of sources and links. The term 
source refers to a connection between a user and a particular destination. The 
source transmits data in packets. The rate at which a source i transmits packets is 
dictated by the source's round-trip time, Xj, as well as window size, Wi. The round- 
trip time is defined as the time between transmission of a packet and receipt of an 
acknowledgement for that packet from the destination. The window size is defined 
as the number of packets which are allowed to be simultaneously unacknowledged. 
In this thesis, we assume that packet losses do not affect the source transmission 
rates, since any lost packet will presumably be detected by the user after one round- 
trip time and resent. We assume that acknowledgements contribute to delay but do 
not contribute to congestion at the links. We assume a fixed bit size for all packets 
and that is known at least for the purposes of determining data rate. The packet 
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transmission rate, Xi, at source i can be controlled by the window size according to 



The term link refers to a single congested resource such as a router. Packets 
arriving at a link enter an entrance queue. A link can process packets in the queue 
at some rate capacity Cj. If too many data packets arrive in a given period of time, 
the size of the queue may grow and some packets may experience a queueing delay 
while in the queue. In this thesis, we assume that the dynamics from this variable 
queueing delay are negligible and we only model the delay due to the fixed propagation 
time. Links must also be able to feed back information. This can be done either 
through the ECN bit in the packet header, through packet dropping schemes or 
through measurement of variations in queueing delay at the source. The value of 
the congestion indicator at hnk j is denoted pj. We also assume that the congestion 
indicator received at each source is the summation of the indicators of all links in the 
source's route. This value is denoted qi. 

Sources and links are related by routing tables which specify the route or set of 
links, Ji through which the packets from source i to its destination must pass. The 
rate of packets received at a link j is then the sum of the rates of all sources using 
that hnk and is denoted by yj. The set of users for hnk j is denoted Ij. Ignoring 
delay for the moment, we have the following equations. 




y^Rx, g = R^p, 



where 




otherwise 



1 if source i uses link j 
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4.3 Optimization Model 

The following model for optimizing flow rates in a network was proposed by Kelly et 
al. [IHl. 

N 

maximize Uijxi) 

i 

subject to a; > 0, Rx < c 

Assume that the f/j are continuously differentiable strictly concave non-decreasing 
functions. If all sources utilize at least one link, then the problem has a unique 
optimum. Note that, as increases, the problem becomes progressively more difficult 
to solve using a centralized algorithm. We now consider the dual problem with dual 
variable p G , where M is the number of links, which is given by 

minimize h{p) 
subject to p > 

where the dual function h is given by 

h{p) = max^^(f/j(sj)) —p^{Rx — c) 

i 

i 

,(p)=max{0,f/;-i(^i?,,p,)} 



= me.x{0,U:~\q,{p))} 
q{p) = R^p 

The map U-^^ : {MUoo} is well defined since G C and Ui is strictly concave. 

We would like to construct a dynamical system which converges to the solution of 
the dual problem. One such system is given by the gradient projection algorithm. In 
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discrete-time, this is 

Pji^ + 1) = max{0,pj(t) - -fjDjh{p{t))}, 

where Dj denotes the partial derivative with respect to the j'th argument and 7-,- is 
the step size. Since the Ui are strictly concave, h{p) is continuously differentiable 
with the following derivatives [2]. 

Djh{p) = Cj - ^ Xopt,i 

= Cj -Voptjip) 
I/opt (p) = RXoptip). 

If 7 is sufficiently small, the discrete-time gradient projection algorithm will converge 
to the solution of the dual problem |221- Because of convexity of the problem, strong 
duality implies that Xopt(p) will converge to the unique optimum of the primal prob- 
lem. A continuous-time implementation of this algorithm in the network framework 
is as follows. 

{ijiyjit) - c,) >o 

[max{0,7j(?/j(t) - Cj)} pj{t) < 
max{0,f/r^(g,(t))} 
Rx{t), q{t) = R^p{t) 



Xi{t) = 

y{t) = 



7j now denotes a gain parameter, corresponding to step-size in discrete time. This 
algorithm has the remarkable property that it is decentralized, corresponding to the 
separable structure of the constraints, pj is computed at each of M links. Link j 
requires only knowledge of yj to compute this value. Xi is computed at each of N 
sources. Source i requires only knowledge of to compute this value. 
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4.4 Stability Properties 



To ensure that the continuous-time gradient projection algorithm will converge when 
implemented with the current Internet framework, we must also consider the delay in 
transmitting packets from the source to the link and then receiving acknowledgements 
at the source. The delay from source i to link j is denoted t/j and the delay from 
link j to source i is denoted rj'j. For any source i, the total round trip time is fixed, 
i.e. Ti = r/j + for all j G Ji. We express these delays in the frequency domain 
by replacing the entries of the routing matrix R with forward and backward delay 
transfer functions W and i?*, giving 

y{s) = Rf{s)x{s), q{s) = R\sfp{s) 



e ^'■'^ if source i uses link j 

otherwise 

e~'^ij^ if source i uses link j 

otherwise 



The work by Paganini et al. jzH] introduced a class of utility functions under which 
this system was shown to have a stable linearization about its positive equilibrium 
point for a fixed gain parameter 7^- = 1/cj. This class was given by the set of f/j such 
that 

where Mi is a bound on the number of links in the path of source i and < 7r/2. In 
particular, the choice of 

TT( \ (^ 1 ^ 

Ui[x) = X I 1 — in ■ 



CYi \ Xri 



with restricted domain x < Xmax,* was suggested in |22JJ as a strictly concave util- 
ity function such that the function U'f^{q) = Xmax.iC "'^i^i'^ > has the necessary 
derivative. 
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4.5 Recent Work 

Some efforts have been made to extend this local stability result to the global case. 
For a single source and a single link, the paper by Wang and Paganini |17j has shown 
this implementation to be globally stable for a < /i(xmax/c), where 



In addition, the paper by Papachristodoulou |31J has shown this implementation to 
be stable when a < /2(a;max/c), where 




/i and /2 are illustrated in Figure Note that when Xmax = c, both these conditions 
become a < 1 which is more restrictive than the local stability bound of a < 7r/2. 
The results presented in the next chapter attempt to eliminate the gap between local 
and global stability results by showing global stability for a < 7r/2/i(xmax/c). 
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Figure 4.2: Plot of and f2{,x) vs. x 



Chapter 5 



Stability of Internet Congestion 
Control 

5.1 Introduction 

In this chapter, we extend some of the hnear stabihty results of Paganini et al. 
discussed in the previous chapter to the dynamics of a nonhnear implementation. 
Many algorithms have been proposed for Internet congestion control, some of which 
have been shown to be globally stable in the presence of delays, nonlinearities and 
discontinuities. These proofs can be grouped into several categories according to 
methodology. In particular, Lyapunov-Razumhikin theory has been used to show 
global stability in (SUl El 113 HZl HH] , Lyapunov-Krasovskii functional have been used 
to show global stability in |2ni IHH ISO] and an input-output approach was taken 
in 1371 nni- In all of these cases, stability has been proven with varying degrees of 
conservatism with respect to restrictions on system parameters or delays. 

In general, stability analysis of nonlinear, discontinuous differential equations with 
delay is quite difficult. Although frequency domain techniques have been shown to 
be effective when applied to linear systems with delay, these tools fail in the presence 
of nonlinearity. In addition, although time-domain analysis of nonlinear finite di- 
mensional systems has had some success, analysis of the infinite dimensional systems 
associated with delay has been more problematic. In this thesis, we are able to obtain 
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improved results by decomposing the nonlinear, discontinuous, delayed system into an 
interconnection of a linear system with delay and a nonlinear, discontinuous system 
without delay. We analyze the subsystems separately and prove a passivity result for 
each. One benefit of such an approach is that it allows us to use frequency-domain 
arguments in addressing the infinite dimensional linear system. We can then use 
time-domain arguments in the analysis of the single state nonlinear system. These 
individual results are then be combined using the newly developed generalized pas- 
sivity framework of Rantzer and Megretski as outlined in Chapter 01 This approach 
yields improved results by allowing us to decompose the original difficult problem 
into simpler subproblems, each of which may be solved with less conservatism. To 
apply the passivity framework of Rantzer and Megretski to the internet congestion 
control problem, we must first transform what is essentially a question of internal 
stability into a problem posed in the input-output framework. Furthermore, because 
input-output stability and internal stability are not equivalent, once a passivity result 
has been proven, we must use further analysis to show that this implies asymptotic 
stability. All these issues are addressed in the following sections. 



5.2 Reformulation of the Problem 



In this section we reformulate the question of internal stability of the proposed con- 
gestion control algorithm as a question of input-output stability of the interconnection 
of a linear system with delay and a nonlinear system without delay. This approach 
was motivated, in part, by the work of WangjTTj and Jonsson 17j. If we consider the 
problem of a single link and a single source, then from the development in Chapter 
we have that y{t) = x{t — t^) and q{t) = pit — r^) where + = t. Given an 
initial condition xq G C,-, the dynamics can now be summarized as p{t) = Xo{t) for 
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t G [— r, 0] and the following for t > 0. 



aiaxg-fp(t-r) _ I /^N ^ Q 

p{t)={ ^ (5.1) 
max{0, £saxe--P(*-^) - 1} p{t) < 



c 



a;(t) = we-^^(*-^ ^ (5.2) 

Since the dynamics of Equation (j5.ip are decoupled from those of (j5.2j) and stability 
of X follows from that of p, we need only consider stability of Equation ()5.H) . Now 
consider the equilibrium point of Equation ()5.1|) . po = ^ In ^laax jg customary, we 
change to variable z, where z{t) = p{t) —po so that the origin is an equilibrium point. 
Now we have z(t) = Xo(t) — po for t G [— r, 0] and the following for t > 0. 

e -f^ii-r) _ 1 z(t) > -Po 

m = { (5.3) 

max{0, e-T^(*-^) - 1} z{t) < -po 

For convenience and efficiency of presentation, we will refer to the solution map 
defined by Equation ()5.3j) a.s A : Cr C. Implicit in these dynamics is the constraint 
z{t) > —po- If we assume that any initial condition will satisfy this constraint, we 
can include the constraint in the dynamics without altering the solution map. For 
convenience, we define the following bounded continuous functions. 

/i(y) = min{e^^-l,e^^°-l} 
f2{y) = max{0, /i(y)} 

^, , , fi{y) iix>-po 
fc{x, y)= -{ 

f2{y) otherwise 



These functions are illustrated in Figure I^!T1 We now have the following equation 
for t > 0. 



Z{t)= f,{z{t),-z{t-T)) 



(5.4) 
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Before proceeding, we must mention well-posedness of the solution map, A. We 
use a method of steps. Given any absolutely continuous solution z{t) on some interval 
[Ti,Ti + r], we observe that z(t) = fc{z{t),z{t — r)) = fc{z{t),t) is a function only 
of time and state z{t) for the interval [Ti + r, Ti + 2r]. From boundedness of the /c, 
continuity with respect to z{t — T) and noting upper semi- continuity of the associated 
differential inclusion with respect to z{t), we can now establish via Fillipov 11 [p77] 
the existence and uniqueness of a continuous solution z{t) over the interval [Ti + 
r, Ti + 2r]. Assuming a continuous initial condition, this implies the existence and 
uniqueness of the solution map A : Cr ^ C. 



5.2.1 Separation into subsystems 

Equation ()5.4p is a delay-differential equation defined by a nonlinear, discontinuous 
function. To aid in the analysis, we will reformulate the problem as the interconnec- 
tion of two subsystems where the W2 stability on W2 x L2 stability of this intercon- 
nection implies asymptotic stability on X of the original formulation for some set X. 
Define the map G by w = Gu if 

w{t) = [ u{e)de. 

Note that G is a linear operator which can be represented by the convolution with 
g{t) = step(t) — step(t — r) G Li. This implies that G ^ A. Moreover, G can be 
represented in the frequency domain by G{s) = which implies G is a bounded 
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operator on L2 since ||G'(jc<j)||oo = t. In addition, sG{s) G A since it can be repre- 
sented by convolution with 6{t) — 6{t — r). Define the map A^hj z = AzU if z{0) = 
and 

z{t) = f,{z{t),y{t)~z{t)). 

We define the map A by f = Ay if v{t) = z{t) where z = A^y. Addressing well- 
posedness, if |/ G W2, then y is absolutely continuous on any finite interval(See p. 25 
in Jonsson [IS])- From boundedness of /c, continuity with respect to y{t), and upper 
semi-continuity of the associated differential inclusion with respect to z(t), we can 
again establish the existence and uniqueness of an absolutely continuous solution z 
and thus of the map A^. Well-posedness of A follows immediately. Further properties 
of A will be derived in later sections. 

If we now form the interconnection of G and ztA for k G [0, 1], as defined above 
with a single input / G we can construct a map from input / to outputs y, u. For 
convenience and efficiency of presentation, we will denote the interconnection map 
for K = 1 by i? : W2 — > x -Z^2e- Furthermore, for k = 1 we denote the map from 
input / to internal variable z by B^. For t < 0, we let u{t) = y{t) = z{t) = f{t) = 
and for t > 0, the interconnection dynamics combine as follows. 

u{t) = K,z{t) 

y{t)= [ u{t)dt + f{t) 

Jt-T 

= 4z{t)-zit-r))+f{t) 
z{t) = f,{z{t),y{t)-z{t)) 

= fMt),fit)-Kzit-T)-{l~K)z{t)) 

As before, from continuity with respect to f{t) and z{t — T), upper semi-continuity 
with respect to z{t) and boundedness of fc, we can conclude existence and uniqueness 
of z G L2e. Since z has bounded derivative and z{t) = for t < 0, we now have that 
the map B^ : W2 W2e is well-posed. Furthermore, this implies that y G W2e and 
u G L2e which yields well-posedness of the interconnection for any k G [0, 1] and 



38 



CHAPTER 5. STABILITY OF INTERNET CONGESTION CONTROL 



specifically of the map B : W2 x L2e- 

5.3 Input-Output Stability 

In this section we use the IQC defined by n^, A = -, where 



n 



B 



/3 

' TT 



and /3 = Q;/(Q;maxT) to establish W2 x L2 stability on W2 of the interconnection for 
any r > 0, < a < 7r/2ainax- Here we define 

'-'^max f-'^('^max/c) / ((^^max/*^) l)- 

5.3.1 A satisfies the IQC 

In this subsection we show that if a > 0, then A and consequently kA are bounded 
and satisfy the IQC defined by fl^, A = | for all k G [0, 1]. The methods used in this 
subsection were motivated by those in Jonnson .17j and Wang pTfj. For 7 = 4/?/7r > 0, 
we prove the following for all y G W2, v = Ay. 



+ -{v,y) 



1 






"0 13 












J TT 




v{juj)_ 



>-i\ym' 

By Parseval's equality, this is equivalent to 

-{v,y-v) + {v,/3y-v)>-1\yi0)\^ 

A critical result used in the analysis of this section is the existence of a sector 
bound on the nonlinearity /i and consequently on j2- 



Lemma 28. < fi{x)x < I3x^ for i = 1,2 where (3 



po 
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Figure 5.2: The nonhnearity /i satisfies a sector 

See AppendixOfor Proof. 

This key feature is illustrated in Figure 15.21 

Lemma 29. If v = Ay with y G W2, then 

1. f G L2 with norm hound (3\\y\\, 

2. {v, (3y-v)>0 

Proof. We start by noting the following. 



fc{x,y) 



fi{y) if a; > -po or y > 
otherwise 



As a consequence of the above sector bounds, we have 



fc{x,yf < (3yfc{x,y). 



Let z = Azy, then this implies 



z{t)' = fc{z{t),y{t)-z{t))z{t) 
<P{yit)-z{t))zit) 
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Now for any T > 0, we have 
\\PtV 



T i-T 



v{tydt = / zitydt 
Jo 

<(3 f z{t){y{t) ~ z{t))dt 
Jo 

= P j%{t)y{t)dt - ^{z{Tf - z{Qf) 



<P{PTZ,y) 

< PWPtzIM 



(5.5) 



Therefore, H-Pr'^ll < PWuW for all T > 0. Thus v E L2 with norm bounded by P\\y\\. 
Statement 2 follows from line 15.51 bv letting T ^ 00. ■ 

Lemma 30. Let z = A^y with y G W2, then lim^^^oo z{t) = 0. 

See Appendix O for Proof. 
Lemma 31. If v = Ay with y E W2, then {v, y — v) > — /3|?/(0)p. 

See Appendix O for Proof. 
Lemma 32. kA satisfies the IQC defined by IIb, = ~ for any k G [0, 1] 
Proof. By Lemmas 1^ and l!?T| we have the following. 



71 



1 




* 


"0 p 








v{juj)_ 




(3-^-2 




v{juj)_ 



= -{v,y-v) +2{v,py~v) 

71 

>-^\ym' 



We conclude as a consequence that kA satisfies the IQC defined by Ub, A = - for 
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any k G [0, 1], since 



TT 



-{kv, y — Kv) + {kv, Py — kv) 



> K{-{v,y-v) + {v,f3y-v)) 



> -K — \y 

TT 



2. 2/3 

> — \y 

TT 



5.3.2 Properties of G 

Recall that we define the map G as follows, w = Gu if 



w{t) 



u{9)d9. 



t-T 



Lemma 33. Suppose < a < namax/'^- Then G satisfies condition^of Theorem 

Proof. Recall that G can be represented as a transfer function in the frequency 
domain by G = ^—^r^^. Now, examine the term 







' Xju* 


) 


'GUuj) 


I 


Xjuj 




I 



1 



2 ■ Real (3 



2 Pt 



P+^JUJ* 
— e" 



1 



TT 



sm 



— COS[UJT) 
IT 



2p{ujT) 



- — — — - cos^cijj — 1 IS given 



Define Po{uj) = p{lu) for /3t = 7r/2. The plot of Po{iu) — ^ ^ 
in Figure 15.31 As one can see, the function is non-positive near the origin. In fact 
for any /?r < 7r/2, there exists an 77 > such that p^u) < —77 for all a;. To see this, 
consider the following domains. 
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-0.5 
-1 
-1.5 

2 4 6 8 10 12 14 

Figure 5.3: Plot of po{uj) = f ^^^^j^ — f cos(co') — 1 vs. lu. 

uj > 27t: We have that < l/27r for \uj\ > 27r and -1 - | cos(c<;)) < -1 + 2/7r 

for all u. Therefore, p{uj) < j — {I + ^ cos(u;)) < < —.1. 

TT — .1 < cij < 2tc: For the interval [vr — .l,27r], we have < .04. Therefore 

p{uj) < -1 + 2/71 + .04f < -.3. 

< UJ < TT — .1: One can see from plot of po in Figure 15.31 that po{uj) < on 
the interval [0, vr — .1]. Since (3t < 7i/2, we can let e = tt/2 — (3t > 0. Then 
= poM - < -6^ < -.2e on [0, vr - .1]. 

Therefore, for any (3t < ^, let t] = minj.l, .2(7r/2 — /3r)}. Then p{uj) < —t] for all 
u; G M. Since /3r = r(erPo _ l)/po = a/«max, if a < vramax/2, we have that /3r < n/2, 
and hence if < a < 7ramax/2, condition HI of Theorem 1771 is satisfied. ■ 

5.3.3 Stability of the Interconnection 

We conclude our discussion of input-output stability with the following Theorem 
concerning the stability of the the interconnection of A and G. 

Theorem 34. Suppose a G {0,TTamax/'^) ■ Then the map B, defining the interconnec- 
tion of A and G is W2 x L2 stable on W2. 

Proof. We have shown that G is a linear causal bounded operator with G{s), sG{s) G 
A. We have also shown that the interconnection of G and nA is well-posed for all 
K, G [0, 1] and Lemma IH^ shows that nA satisfies the IQC defined by n^, = f for ah 
K G [0, 1]. Finally, by Lemma l33l we have that for all a G (0, Tramax/S), conditionEJof 
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Theorem 1271 is satisfied. We can therefore use Theorem |2ZI to prove W2 x L2 stabihty 
on W2 of the interconnection for any a G (0, 7ramax/2). ■ 

5.4 Asymptotic Stability 

In this section, we show that W2 x L2 stabihty on W2 of the interconnection imphes 
asymptotic stabihty of the original formulation of the congestion control protocol. 
Recall that the original solution map A is defined by the following. 

zit) = Uz{t),-4t-r)) t>0 (5.6) 

z{t)=xo{t) te[-T,0] (5.7) 

The interconnection maps B and B^, however, are defined by the following differ- 
ential equation. 

z{t) = f,{z{t), fit) - z{t - r)) t>0 (5.8) 

z{t) = t < (5.9) 

In the previous section, we have proven W2 x L2 stability on W2 of the map B 
where B represents a reformulation of the problem in the input-output framework. We 
would like to show, however, that for some X G Cr this result also implies asymptotic 
stability on X of the solution map A, where A represents the original formulation of 
the problem. This is done in the following Theorem. 

Theorem 35. Suppose a G {0,TTamax/'^) ■ Then the delay- differential equation ()5.H) 
describing the algorithm proposed by Paganini et al. }2fM is asymptotically stable on 
X = {x : X eW2 r\Cr,x{t) > -Po,x{-t) > -po}. 

Proof. We have already shown W2 x L2 stability on W2 of the map B. Let 
Xo G X be an arbitrary initial condition. Theorem 11211 in the Appendix states that 
for any initial condition xq G X, there exists some / G W2 and T > such that 
A{xo,t) = B,{f,t + T) for ah t > 0. Let {y,u) = B{f), then y G W2. Furthermore, 
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recall B^f = A^y where B^ is the map to internal variable z. By Lemma EDI if 
y e W2, then lim^^oo A^{y, t) = 0. Therefore, limt^oo M^o, t) = lim^^oo B^{f, t+T) = 
hmt_^oo A^{y,t + T) = 0. ■ 

5.5 Implementation 

To implement the proposed algorithm in the Internet framework, the window size 
can be adjusted to deliver the required packet rate as given by equation ()4.H1 . In 
implementation, the delay is unlikely to be known. In this bound on the 

expected delay size can be used. Overestimation of the delay will result in an increased 
stability margin. 

Modification of the link can take many forms. Price information from the link 
must be fed back to the source. Since queues themselves integrate excess rate, price 
of a congested resource can be computed directly using the queueing delay. How- 
ever, this approach results in non-empty equilibrium queues and the possibility of 
unmodeled dynamics due to variable queueing delays. If a link instead uses a virtual 
capacity to avoid non-empty equilibrium queues, then explicit integration of incoming 
packets would be required and another mechanism must be used to feed back price 
information. An example of direct feedback of price information using packet mark- 
ing is given by ECN. In one of the proposed implementations, packets are randomly 
marked at each link with probability 1 — for some fixed (p > 1. Thus, assuming 

no duplications, if u is the percentage of marked packets received at the source, then 
the aggregate price can be measured as qi{t) = This variant is known as 

random exponential marking. 

5.6 Conclusion 

To summarize, for the case of a single source with a single link, we have demonstrated 
both input-output and asymptotic stability. We have used a generalized passiv- 
ity framework to decompose a difficult nonlinear, discontinuous, infinite-dimensional 
problem into separate linear, infinite-dimensional and nonlinear, finite-dimensional 
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subproblems, each of which is amenable to existing analysis techniques. A key fea- 
ture of the analysis of the nonlinear subsystem was the existence of a sector bound 
on the nonlinearity. 

In addition to the case of a single source with a single link, the result presented 
in this chapter applies directly to the case of multiple sources with identical fixed 
delay. The proof may also be easily adapted to alternate implementations of the 
proposed linearized protocols so long as they admit a similar sector bound on the 
nonlinearity. Although we would like to have proven a result in the case of multiple 
heterogeneous delays and arbitrary topology, we have as yet not been able to construct 
an appropriate sector bound. The root of the problem seems to lie in the discontinuity 
due to the projection used in the gradient projection algorithm. 



Chapter 6 

Sum-of-Squares and Convex 
Optimization 

6.1 Convexity and Tract ability 

Consider the following optimization problem for /j e M[x] ior i — . . .Uf. 

max/o(x) : 

fi{x)>0, i^l,...,nf 

The problem as formulated is clearly, in general, not convex. In fact, many NP- 
hard problems can be formulated in this manner. However, if we define Y :— {x : 
fi{x) > 0, i — l...nf}, then the problem can be recast as an equivalent convex 
optimization problem as follows. 



mm 7 : 

7 - Mx) e 

Although this reformulation is convex, we must conclude that it too is intractable. 
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unless we believe that P = NP. The point that we make with this section is that 
convexity, by itself, is not a sufficient condition for tractability of a problem. What 
we need in addition is an efficient affine test for membership in the convex cone. Con- 
struction of such membership tests for various convex sets is the goal of Chapters IHl El 
and El 

6.2 Sum-of-Squares Decomposition 

Any polynomial, / G R[x], of degree d and n variables can be expressed as the linear 
combination of ("^'^) monomials. 

f{x)= ■ ■ ■ TM-ez^ (6.1) 

i=l 

The question of whether / G V~^, that is, f{x) > for all x G M", is NP hard for 
polynomials of degree 4 or more. Thus there is unlikely to exist a computationally 
tractable set membership test for unless P = NP. However, there may exist some 
convex cone S C for which the set membership test is computationally tractable. 
One such cone is defined as follows. 

Definition 36. A polynomial s G M.[x] satisfies s G if it can be represented in the 
following form for some finite set of polynomials gi G M\x], i = 1 . . .m. 

m 
i=l 

An element s eT^s is referred to as a sum-of -squares polynomial. The set is 
defined as the elements of of degree d or less. 

Lemma 37. C P+ 

In jSSl; it was shown that the set membership test / G Ss is computationally 
tractable. 
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Lemma 38. A degree 2d polynomial f G M[x] satisfies f & Tj^ if and only if there 
exists some matrix Q G S""^ where rtz = ("'^'^) , such that Q > and 

f{x) = Z,[xfQZ,[x]. 

The equality constraint in Lemma IHHl is affine in the monomial coefficients of /. 
Therefore, set membership in can be tested using semidefinite programming. The 
question of how well represents has been a topic on ongoing research for some 
time. It was conclusively shown through use of the Motzkin polynomial that in gen- 
eral T,s 7^ V^. However, if we define to be the convex cone of sums of squares of 
quotients of polynomials, then Artin showed that S,. = Not surprisingly, how- 
ever, there is no tractable set membership test for E^. As an interesting corollary of 
this result, it was shown that / G if and only if there exists some (7 G such that 
fg G S^. This does not constitute a tractable set membership test, unfortunately, 
since no bound is given on the degree of g. In addition, the introduction of the auxil- 
iary variable g destroys the convexity of the constraint since the resulting feasibility 
problem is bilinear. Building on this work, however, Reznick showed that if / G V^, 
then there exists some d G Z^ such that {x'^xY{f{x) + 1) G Ss. This result provides 
a test for membership of / in the interior of V^, but not a tractable one, as there are, 
in general, still no bounds on d. What the result of Reznick does provide, however, 
is a sequence of tractable tests for membership in the interior of V^, indexed by the 
integer d. 

6.3 Positivstellensatz Results 

Membership in the cone is harder to approximate than V^. Consider a region 
Kf of the following form for G ]R[x], i = 1, . . . , n^- 

Kf := {a; G : f,{x) > 0, z = 1, . . . , Uk}. 

Then /q G V^f if and only if the following set is empty. 
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:= {x G M" : -/o(x) > 0, /o(x) ^ 0, /.(x) > 0, ^ = l,...,nx} 

A condition for emptiness of the set Kj comes from the following simplified Posi- 
tivstellensatz result from Stengle [H]. 

Theorem 39. Let Kf be given as above and let I denote the set of subsets of 
{0, . . . jUk}- Then — /o G V^^ if and only if there exist s G S^, Sj G for J E I 
and k G Z+ such that 

six) + j2 ^^(^) n /^(^) + = 

The Positivstellensatz condition given by Stengle is not tractable, due to the 
introduction of bilinear terms sjfo and since no degree bound exists on either k 
or the degrees of the sj. In the work by Schmiidgen, the convexity problem was 
addressed by considering the case when Kf is compact. This result can be stated as 
follows. 

Theorem 40. Let I be the set of subsets of {1, ... , uk} and suppose Kf, as defined 
above, is compact. Suppose f lies in the interior of V^f . Then there exist sj G Sj, 
for J E I , such that the following holds. 

f{x)-J2sAx)llf.ix)eE, 

Jei 

Theorem EUl differs from Stengle's result by essentially allowing us to set sj = 
when ^ J. This means that the resulting constraint is convex. However, 
Schmiidgen's result still does not constitute a tractable condition since there exist 
no bounds on the degrees of the sj. The theorem does, however, suggest a method 
for constructing a sequence of sufficient conditions for membership in the set V^^ by 
considering elements of of bounded degree. 

Definition 41. For a given degree bound, d, and compact semi- algebraic set, Kf, 
of the form given above and I as defined above, we define the convex cone A^^ of 
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functions f G M[x] such that there exist functions Sj G 
less, such that the following holds. 



for J G I , of degree d or 



f{x)-Y,sAx)l[f,{x)eJ:s 



Lemma 42. For any d G Z+ and any Kj, ^ C 

Testing membership in A^^ is a tractable problem for any fixed d and Kj and thus 
provides a tractable sufficiency test for membership in V^f . However, the complexity 
of the test scales poorly in n^. This problem was addressed to some extent by the 
work of Putinar , which showed that under certain additional restrictions on the 
set Kf., that we can assume that sj = for all J except J = 1, . . . , nx- This theorem 
is stated as follows. 

Definition 43. We say that fi G M[x] for i = 1, . . . ,nK define a P-compact set 

Kf, if there exist h G M.[x] and Si G for i = 0, . . . , uk such that the level set 
{x G M" : h{x) > 0} is compact and such that the following holds. 



The condition that a region be P-compact may be difficult to verify. However, 
some important special cases include: 

• Any region Kf such that all the fi are linear. 

• Any region Kf defined by fi such that there exists some i for which the level 
set {x ■ fi{x) > 0} is compact. 

Thus any compact region can be made P-compact by inclusion of a redundant 
constraint of the form fn^+i P ~ fo^' sufficiently large /3. However, for such 
an inclusion, we must have some explicit bound for the size of the original region. 

Theorem 44. Suppose Kf, as defined above, is P-compact. Suppose f lies in the 
interior ofV^f. Then there exist Si G for i = 1, . . . ,nK, such that the following 
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holds. 

■n-K 
i=l 

Theorem 1^ is similar to the Positivstellensatz result of Schmiidgen in that it does 
not represent a tractable test for membership in V^^ since no bounds exist for the 
degree of the Sj. However, Putinar's Positivestellensatz provides a basis for a less 
computationally intensive sequence of tractable sufficient conditions. 

Definition 45. For a given degree bound, d, and semi- algebraic set, Kf, of the form 
given above, we define the convex cone T^^ of functions f G M[x] such that there 
exist Si G Sf for i = 1, . . . , uk, such that the following holds. 

UK 

fi^) - ^Si{x)f,{x) G 

i=l 

Lemma 46. For any d G Z+ and any Kf, T^^ C V^f 

Membership in the set T^^ is a tractable problem for any d G Z'^ and Kf and 
can be tested using semidefinite programming. Moreover, for any fixed d, the test 
associated with T^-*^ is less computationally difficult than that associated with A^^, 
especially for large values of uk- However, such statements should be taken with a 
grain of salt, since, for a fixed d, A^^ may well provide a better approximation of 
V^f than Tf^ 



6.4 Applications 

In this section, we demonstrate some applications of the techniques provided in Sec- 
tions l6.2l and l6.3l to stability of nonlinear ordinary differential equations. Our concepts 
of stability are the same as those defined for functional differential equations, albeit 
with a state space defined in as opposed to C^. 
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6.4.1 Stability of Ordinary Differential Equations 

Consider a time-invariant ordinary differential equation of tlie following form. 

x{t) = f{x{t)) 

Here x{t) G and / is a polynomial of degree m such that /(O) = 0. 

Theorem 47. The system defined by the polynomial function f is globally stable if 
there exists an a > and a Lyapunov function, V{x), with continuous derivatives 
such that V{0) = and the following holds. 

V{x) > ax^x 
VV{xff{x) < 

//, in addition, V{x)^f{x) < —ax^x for all x G M", then the system is globally 
asymptotically stable. 

By using the methods of the Section 16.21 we can pose the question of existence 
of Lyapunov function proving global stability of the system as a convex feasibility 
problem in the cone . Then, by approximating by S^, we can construct a 
sequence of sufficient conditions, of increasing accuracy, indexed by integers n > 0, 
which can be expressed as semidefinite programs. 

Theorem 48. The origin is globally asymptotically stable if there exists aV E M\x], 
of degree d, and an a > Q, such that the following conditions hold. 

V{x) — ax^x G 
-{yV{xff{x) + ax^x) G 

6.4.2 Local Stability and Parametric Uncertainty 

Consider a time-invariant ordinary differential equation of the following form. 



for all X eW 
for all X G M' 



x{t) = f{p,x{1:)) 
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Here x{t) G M", J9 G R'^" and / is a polynomial of degree m such that f{p, 0) = for 
all p & K G W^p. We first give a local, parameter-dependent version of Theorem IT7I 

Theorem 49. Let C R" contain an open neighborhood of the origin and f G M[p, x] 
satisfy f{p, 0) = for all p G K . Suppose there exists an a > and a Lyapunov 
function, V{p,x), with continuous derivatives such that V{p,0) = for p G K and 
the following holds. 

V{p, x) > ax'^x for all x E Vl, p E K 

VxV{p, x)^f{p, x) <0 for all X E Q, p E K 

Then, for any p E K , the system defined by f is stable on some open neighborhood of 
the origin. If, in addition, V{p,x)^ f{p,x) < —ax'^x for all x E Vt and p E K, then 
for any p E K , the system is asymptotically stable on some open neighborhood of the 
origin. 

Suppose the sets VL and K are given by and Kp., respectively, where '.= 
{a; G M" : gi{x) > 0, i = 1, . . . , for gi E R[x] and Kp := {p E R'^^ : hi{x) >0,i = 
1, . . . ,nh} for hi E R[x]. Now let the set be the intersection of the sets and 
Kp in the product space R""'"'^p, defined as follows. 

K^ := {{p, x) E ■.pEKp,xE K,} 

By using the methods of the Sections 16.21 and 16.31 we can pose the stability con- 
ditions associated with Theorem |33 as a convex feasibility problem in the convex 
cone V^^ . Then, for a given d E Z'^, by approximating by A^^ or T^^, we 
can construct a sequence of sufficient conditions, of increasing accuracy, indexed by 
integers d,r >0, which can be expressed as semidefinite programs. 

Theorem 50. Let f be a polynomial such that f{p,0) = for all p E Kp and K^ 

contain an open neighborhood of the origin. Suppose there exists a V E R[p,x], of 
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degree r, and an a > such that the following conditions hold. 

V{p, x) — ax^x E T^^ 
-{V,V{p, xffip, x) + ax^x) e Tf 

Then, for any p E Kp, the origin is asymptotically stable in some open region about 
the origin. 

6.5 The SOS Representation of Matrix Functions 

The previous sections discussed tractable tests for membership in the convex cones 
and of non-negativity scalar polynomials. In this section, we present an 
extension of these results to the convex cones and of non-negative matrices 
of polynomials. A simple test for M E or M e 5^ can be performed through the 
introduction of n auxiliary variables. 

Lemma 51. For M E S"[a;], let /m G be defined as f{x,y) := y^M{x)y. 

1. M E S+ if and only if fn e V'^. 

2. M eS^ if and only if fu e V^' , where K' := {{x, y) : x E K}. 

Thus, we can determine whether M E by testing whether E using the 
techniques discussed in the previous section. The problem with this approach is that 
the size of the resulting semidefinite program scales very poorly in the dimension of 
M. This is due to the introduction of the auxiliary variables y. Instead, we will 
consider the following direct approximation to the cone S^. 

Definition 52. M E §"[a;] satisfies M G S^, if it can he represented in the following 
form for some finite set of polynomial matrices Gi E M"^"[x]; i — 1, . . . , m. 



m 

M(x) ^J2^,(xfG,(x) 

i=l 
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An element M & 'Eg is referred to as a sum- of -squares matrix function. Fur- 
thermore, define to be elements of of degree d or less. 

We now provide a tractable test for membership in E^. 

Lemma 53. Suppose M G S^W f^^ ^ ^ ^ if O'nd only if there exists 

some matrix Q G S"^'"", where = ("^^'^) such that Q > and the following holds. 

M{x) = {Z^[x]f QZ^[x] 

See Appendix lEl for Proof. 

The complexity of the membership test associated with Lemma IS^ is considerably 
lower than that associated with Lemma 1^ Specifically, the variables associated with 
the first test are of order as opposed to order {"'^"'^^f^^)- Furthermore, the 

use of the test associated with Lemma ESI does not increase the conservatively, as 
evidenced by the following lemma. 

Lemma 54. M{x) G if and only if y^M{x)y G S^. 

See Appendix iBl for Proof. 

As for and V^, the question of how well approximates is an open 
question. However, in the case of a single variable, we have the following result due 
to Choi et al. 0. 

Lemma 55. For x & M ^ Ei^[x], the following are equivalent 

• M G 

• MG5+. 



Lemma ESI will find considerable application in Chapter [7| 
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6.6 Positivstellensatz Results for Matrix Functions 

In this section, we consider membership in the set Sn for some semi-algebraic set 
Kf, defined by polynomials /j G ]R[ follows. 

Kf:={x:fi{x)>0, z = l...nj} 

Scherer and Hoi [33] have proven the following generalization of Putinar's Posi- 
tivstellensatz. 

Kf 

Theorem 56. Suppose that Kf is P-compact and M G Sn ■ Then there exist rj > 
and Si G Ss for i = 1, . . . ,nf such that the following holds. 

M{x)-Y,f^i^)S^{x)-eI ef:s 
i=l 

Theorem 1561 does not represent a tractable test for Sn , since no degree bounds are 
given on the Si. However, the result does suggest a sequence of sufficient conditions, 
indexed by d G Z+, and defined as follows. 

— Kf — J 

Definition 57. We say that M G T^ ^ if there exist rj > and Si G for i = 
1, . . . ,nf such that the following holds. 

M{x)-J2^WS^{x)e^:s 

i=l 

Lemma 58. For any d>0 andKf, T„^C5„^ 

Therefore, for any (i > 0, we can construct a tractable test for membership in the 
convex cone T^^, expressible as a semidefinite program. Furthermore, as d increases, 
T^^ will constitute a better approximation for Sn^ . 
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6.6.1 Linear ODEs with Parametric Uncertainty 

The most common application for the sum-of-squares matrix representation is the case 
of a hnear finite-dimensional system which contains uncertainty. Consider a system 
of ordinary differential equations of the following form where A : M"^". 

x{t) = A{y)x{t) yeG (6.2) 

The following is a standard result in analysis of LTI systems. 

Theorem 59. The system defined by Equation \6.^ is globally asymptotically stable 
for all y & G if and only if there exists a matrix function P : G — such that the 
following conditions hold. 

P{y) -les^ 

-{A{yfP{y)+P{y)A{y) + I)eS^ 

Now suppose that G is a semi-algebraic set defined by polynomials {gi}^li. Then 
for integer c? > 0, we can approximate the conditions EHl using the following. 

Theorem 60. The system defined by Equation I6'.ij| is globally asymptotically stable 
for all y & G if there exists a matrix of polynomials P G such that the following 

conditions hold. 

P{y) - / e Tl, 
-[A{yfP{y)+P{y)A{y)+I)^Tl, 

The conditions of Theorem IHOl can be expressed as a semidefinite program. 
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6.7 Conclusion 

This chapter has detailed a method for expressing may difficult problems in control 
as convex optimization problems. These optimization problems are, in general, not 
tractable due to the lack of an efficient membership test for the convex cone V~^. 
However, we have shown that by approximating by S,,, one can construct tractable 
approximations. The techniques and concepts of this chapter will play an integral role 
as we seek to generalize the ODE applications presented in subsections 16.4.11 16.4.21 
and 16.6. Ti to differential equations which contain delay. 



Chapter 



7 



Stability 
Systems 



of Linear Time-Delay 



7.1 Introduction 

The study of stability of systems of differential equations which contain delays has 
been an active area of research for some time. A complete summary of the results 
in this field is beyond the scope of this section. However, an overview of these re- 
sults can be obtained from various survey papers and books on the subject, see for 
example [121 CH UHl i2H]- The previous results on this subject can be grouped into 
analysis either in the frequency- domain or in the time-domain. Frequency-domain 
techniques apply only to linear systems and typically attempt to determine whether 
all roots of the characteristic equation of the system lie in the left half-plane. Time- 
domain techniques generally use Lyapunov-based analysis, an approach which was 
extended to infinite dimensional systems by Krasovskii in [20]. Stability results in 
this area are grouped into delay-dependent and delay-independent conditions. If a 
delay-dependent condition holds, then stability is guaranteed for a specific value or 
range of values of the delay. If a delay-independent condition holds, then the system 
is stable for all possible values of the delay. A particularly interesting result on the 
linear delay-independent case appears in 

In this chapter, we show how to compute solutions to an operator-theoretic version 
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of the Lyapunov inequality using semidefinite programming. This inequahty, defined 
by the derivative of the complete quadratic functional, can be posed as a convex 
feasibility problem over certain infinite-dimensional convex cones defined by positive 
operators on certain subspaces of Cr- Our result is expressed as a nested sequence 
of sufficient conditions which are of increasing accuracy and can be tested using 
semidefinite programming. Our approach is based on parameterizing the convex 
cones mentioned above using polynomial functions of bounded degree. 



7.2 Positive Operators 



In this section, we present the convex cones of positive multiplier and integral oper- 
ators which define the complete quadratic functional and some its derivative forms. 
We then use polynomials of bounded degree to parametrization certain convex sub- 
sets of these cones in terms of positive semidefinite matrices. These results will allow 

us to express the Lyapunov stability conditions in terms of semidefinite programming 
problems. To begin, consider the complete quadratic functional. 

V{x) = x{OfPx{0) + 2 x{0fQ{9)x{9)d9 
+ / x{9f S{9)x{9)d9 + I I x{9fR{9,u)x{u)d9(ku 



We can associate with V and e > an operator A : Cr ^ Cr such that V{x) = {x, Ax), 
where A is defined as follows. 



P-el Q{9) 
Q{9f S{9) 

{A,y){9) + {A2ym, 




R(9,u;) 



y{u))duj 



The operator A is a combination of multiplier operator Ai and integral operator 
A2. The complete quadratic functional, V satisfies the positivity condition of the 
stability theorem with m(0(O)) = £0(0)^ if the integral operator, ^2, is positive on Cr 
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and there exists some e > such that the multiphcation operator, Ai, is positive on 
the subspace X cCr where 



We now define the specific sets of operators which define the complete quadratic 
functional and its derivative forms. 

Definition 61. For a matrix-valued function M : M — >■ S", we denote by Am the 
multiplication operator such that 



Definition 62. For a matrix-valued function i? : R x M — M"^" such that R{6,u) = 



Definition 63. For a continuous matrix-valued function M, we say M e if 
{x, Amx) > for all X & X . 

Definition 64. For a continuous matrix-valued function : R x R — > R"^" such 
that R{9, cu) — R{u!, 9)'^, we say R e if^ if {x, Brx) > for all x & Cr- 

Definition 65. For a piecewise- continuous matrix-valued function M, we say M e 
Ht if {x, Amx) > for all x e X. 

Definition 66. For a piecewise- continuous matrix-valued function : RxR — > R"^" 
such that R{9, cu) = R{u, 9)^ , we say R G H2 if {x, Brx) > for all x E Cr- 

Definition 67. For a continuous matrix-valued function M, we say M e if 



X :— {x & Ct I tX 



and = 2:2(0) for all 9}. 



{Amx){9) = M{9)x{9) 



R{u!, 9)^ , we denote by Br the integral operator such that 
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{x, Amx) > for all x G X3, where 



T T T 
•^1 -^2 -^di 



X3 := {x G Ct- I , X 

X2{0) = X3(— r) for all 9}. 



1 T 



and Xi{9) = X3(0) and 



Definition 68. For a piecewise- continuous matrix-valued function M , we say M G 
if {x, Amx) > for all x G X3, where 



X, 



x^ 



X 



K+2 



and 



Xi{9) = x/r+2(-ri_i) for all 9, i = 1, . . . , K + l\ . 



7.2.1 Multiplier Operators and Spacing Functions 

In this subsection, we consider tlie convex cones and wliicli define positive 
multiplication operators on Xi and X3 respectively. We use the following theorem. 



Theorem 69. Suppose M : 
the following are equivalent 



S is a continuous matrix-valued function. Then 



1. There exists some e > such that the following holds for all x E Cr- 



x(0) 
x{9) 



-I T 



M{9) 



x(0) 
x{9) 



d9 > e||x||2 



2. There exists some e' > and some continuous matrix-valued function T : 
S" such that the following holds. 



M{9) + 



T{9)d9 = 

T{9) 







s'l 



> for all 9 G [-r, 0] 



See Appendix lUl for Proof. 
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Definition 70. Given n and t, we refer to any piecewise- continuous matrix-valued 
function T : R ^ W such that j\T{d)dd = as a spacing function, denoted 

Ten. 



This theorem states that any element of H{' which satisfies a certain additional 
positivity condition can be represented by the combination of a positive semidefinite 
matrix-valued function and a spacing function. This allows us to search for elements 
of by simultaneously searching over the set of positive semidefinite matrix- valued 
functions and the set of spacing functions. For any o? e Z+, the following gives a 
tractable condition for membership in H^. 

Definition 71. Given n and t, define fl^ to be the set of functions T e such 
that the following holds. 



Definition 72. For a given d > 0, M e §^"[6'] satisfies M e Gf if there exists a 



Membership in the convex cone Gf can be implemented as a semidefinite pro- 
gramming constraint by noting that the constraint that a polynomial integrate to 
is affine in the coefficients and that for the single variable case, = . We now 
consider H^. We can use a simple extension of the previous theorem. 

Lemma 73. Let M : R — > S^" be a continuous matrix-valued function. Then the 
following are equivalent. 

1. There exists an e > such that the following holds for all x & Cr. 




T efl'^ such that 



M{9) + 



T{e) 






x(0) 
x{-t) 

x{e) 



M{0) 



x{0) 
x{-t) 
x{9) 
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2. There exists some e' > and a continuous matrix-valued function T : 
such that the following holds. 



T{e)de = 
M{e) 



T{e) 

-e'l 



> for all e e [-T, 0] 



S2n 



See Appendix IdI for Proof. 

Definition 74. For a given d > 0, M E S^"[6'] satisfies M E if there exists a 
T e such that T eVL'i and 



M{e) 



T{e) 





Similar to Theorem 1^21 Lemma [731 allows us to use C to replace M G 
with a semi definite programming constraint. 



Piecewise-Continuous Spacing Functions 

We now consider the sets and of piecewise continuous functions which define 
positive multiplication operators on Xi and X3 respectively. The following lemma is 
a generalization of Theorem 1^21 

Lemma 75. Suppose : M — S^", i = 1, . . . ,K are continuous symmetric matrix- 
valued functions with domains [— r^, — rj_i] where Ti > rj_i for i = 1,...,K and 
To = 0. Then the following are equivalent. 

1. There exists an e > such that the following holds for all x E Cr^. 

K r-n 



x(0) 
x{Q) 



x(0) 



de > 



ex 
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2. There exists an e' > and continuous symmetric matrix valued functions, Ti 
M ^ such that 



K 



W) 

-e'l 

'r,(^) = o. 



> for 9 E [—Ti, — rj_i], i = 1, . . . , K and 



See Appendix IdI for Proof. 

Lemma 1731 alfows us to represent the constrain S G Hi by considering a piecewise- 
continuous function S to be defined by S{9) := Si{9) for 9 G [— r,;, — r,;_i]. 

Definition 76. Given n and t, define Cl^ to be the set of piecewise- continuous func- 
tions T : M ^ §" such that T{9) = Ti{9) for Ti G and 9 G [-n, -n^i] where 
i = 1, . . . , K and such that 



K 

E 

i=l 



Ti{9) = 0. 



Definition 77. For a given d > 0, we say that M : R ^ S^** satisfies M E Gf if 
there exists Mi E §^"[6*] such that M{9) = Mi(9) for 9 E [—Ti, — rj_i] and there exists 
a T E Clp, defined by Ti E ^'^[9] on the interval [—Ti, — rj_i], and such that 



M,{9) + 







G S. 



2n 



i = 1, 



K. 



Similar to Theorem EHl Lemma [7S1 aUows us to use G^ C to replace M E 
with a semidefinite programming constraint. Now for , we have the following 
lemma. 

Lemma 78. Suppose : M — §"(^+2) Q^-g continuous matrix valued functions with 
domains [—Ti, — ri_i] for i = 1, . . . ,K where Ti > rj_i for i = 1, . . . ,K and tq = 0. 
Then the following are equivalent. 
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1. There exists an e > such that the following holds for all x G Cr,^- 



K 

E 





T 




x(-ro) 








Si{e) 


x{-Tk) 


x{-Tk) 




x{e) 




x{e) 



de > eWxWl 



2. There exists an e' > and continuous matrix valued functions Tj : M ^ §"(^+i) 
such that 



K 



W) 

-e'l 



> for 6 G [— Tj, — rj_i], i = 1, . . . , K and 



-n-i 



T,{9) = 0. 



i=l 



See Appendix iDl for Proof. 

Definition 79. For a given d>0, we say that M : R ^ §"(^+2) satisfies M e Gj 
if there exist Mi G Sf'^^^^O] such that M{e) = Mi{e) on [-r^, -ri_i] and Ti G 
^d*'^'*'^'' [^] such that T{6) = Ti{6) on [—Ti, — rj_i] implies T G fi^ and such that 



Mi{e) + 



W) 




Similar to Theorem 1^21 Lemma [THl allows us to use Gg C to replace M G 
with a semi definite programming constraint. 



Parameter-Dependent Spacing Functions 

In this subsection, we consider the case which arises when the dynamics of the system 
depend on some uncertain time-invariant vector of parameters. 
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Lemma 80. For a given d G Z+ and S G suppose there exists some T G 

SJ] [^^,?/] such that the following holds. 



T{9,y)d9 = 



S{9,y) 



Then S{-,y) e H+ for all yeW. 



ne,y) 





Now suppose we wish to impose the condition that S{-,y) G for all y E {y : 
Pi{y) > 0, 2 = 1, . . . , A^} for scalar polynomials Pi. 

Lemma 81. Suppose there exist functions Si such that Si{-, y) G for i = 0, . . . , N 
for all y and such that the following holds. 

N 



s{e,y) = So{e,y) + J2My)s^{0,y), 



1=1 



Then S{-,y) G for all y E {y : p.{y) > 0,t = 1, . . . , N} 

The purpose of these lemmas is to show how our representation of Hi can be used 
to prove stability in the presence of parametric uncertainty. Clearly, these results 
are motivated by the construction presented in Chapter IHl The generalization 
of Lemmas |Hni and |^ to , and is similar and therefore not explicitly 
discussed. 

7.2.2 Positive Finite-Rank Integral Operators 

We now consider the set H2 of continuous matrix-valued kernel functions which 
define positive integral operators on Cr. These operators are compact and satisfy the 
following inequality for all x E Cr. 

rO 

x{efk{e,uj)x{Lu)dedLu > 
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Because Cr is an infinite dimensional space, we cannot fully parameterize the 
operators which are positive on this space using a finite-dimensional set of positive 
semidefinite matrices. Instead, we will consider the subset of finite-rank operators. 

Theorem 82. Let A be a compact Hermitian operator which is positive on Y^ C Cr, 
where 

Yd '■= {p & Cr '■ p is an n- dimensional vector of 

univariate polynomials of degree d or less.} 

Then there exists a positive semidefinite matrix Q G such that 



k{e,u) :-- 



x{9yk{9, uj)x{uj)deduj vx e y„ 



Q 



Zd\^\ 



ZdM 



where recall Zd[6] is the {d+ 1)- dimensional vector of powers of 6 of degree d or less. 

Before proving the theorem, we quote the following lemma which follows directly 
from the Spectral Theorem 

Lemma 83. Let {ciYi^i ^ basis for some finite dimensional subspace Y of an inner 
product space Z . Let A be some compact Hermitian operator which is positive on Y . 
Then there exists some K > such that the following holds for all x eY . 



{x. 



= Kij{ei,x){ej,x) 



Proof. Define to be the transpose of the i^^ row of Z^, then {ei}^^^^'' forms a 
basis for the finite dimensional subspace Ym C Cr- By Lemma IH^ there exists some 
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Q > such that the following holds where p — n{d + 1). 



p 



{x,Ax) — ^ ] Qij{ei,x){ej,x) 




I Qijei{efx{e)ej{ujfx{uj)dedi 




■0 /-O P 




x{9fZ2[efQZ^[Lu]x{Lu)dedLU 



Definition 84. For a given integer d > 0, we denote the set of kernel functions which 
defined compact Hermitian operators which are positive on by G"^. 

This theorem shows how we can use semidefinite programming to represent the 
subset which consists of finite rank elements of the convex cone with polyno- 
mial eigenvectors of bounded degree. Naturally, as we increase the degree bound, d, 
the rank of the operators in G"^ will increase, as will the computational complexity 
of the problem. 

Piecewise-Continuous Positive Finite-Rank Operators 

In this subsection, we consider the set of matrix-valued kernel functions which 
are discontinuous only at points 6,iu = {~Ti}^^ and which define positive integral 
operators on Cr- Although the results of the previous section can be applied directly, 
the kernel functions defined in such a manner will necessarily be continuous since they 
are constructed using a finite number of continuous functions. In order to allow for the 
construction of operators defined by piecewise-continuous matrix valued functions, we 
use the following lemma. 

Lemma 85. Let M be a matrix valued function M : M."^ which is discontinuous 

only at points 9,u! = —Ti for i = 1, . . . , K — 1 where the Ti are increasing and Tq = 0. 
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Then M G H2 ^/ '^^^ only if there exists some continuous matrix valued function 
i? : ^ j^ni^-xnx g^^j^ ^^^^ ^ following holds where li = [— Tj, — rj_i], 

\ = Ti — Tj-l- 

M{e, uj) = M,j{9, uj) for all 9 E h, to E Ij 



Rki{6,uj) ... Rkk{0,uj) 



See Appendix iDl for Proof. 



Definition 86. For an integer d > 0, we denote by G2 the set of piecewise continuous 
matrix valued functions M : — S" such that there exist some R : M."^ ^ ^nKxnK 
such that R E G2 and the following holds where Li, Aj are as defined above. 

M{e,uj) = Mij{e,uj) for all e E li, uj E Ij 
i\/r ta \ n f '^^ a , 'T'k Tk Tk 



R{e,uj) 



Rii{d,uo) ... RiK{e,ij) 
Rki{0-,uj) ... Rkk{0,uj) 



Lemma IH^ allows us to use elements of the set G2 to represent the subset of H2 
of finite-rank operators with piecewise-continuous eigenvectors. Since the transfor- 
mation from G2 to G2 is affine, this allows us to replace R E H3 with a semidefinite 
programming constraint. 
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7.2.3 Parameter Dependent Positive Finite-Rank Operators 

We now briefly discuss the extension of tlie results of the previous two subsections 
when the dynamics contain parametric uncertainty. 

Lemma 87. For a given d G Z"*", suppose there exists a P & such that 

Then M(-, -, a) G for all a G 

Define Kp := {a : Pi{a) > 0,i = 1, . . . ,1}. 
Lemma 88. For a given d G Z"*", suppose there exist P G ^ such that 

M{9,cu,a) = Z^[9fPia)Z^[uj]. 

Then M(-, ■, a) G H2 for all a G Kp. 

These lemmas allow us to search for parameter dependent positive integral oper- 
ators using the set of positive semidefinite matrix functions. The extension of these 
lemmas to the set H2 should be clear and is not explicitly discussed. 

7.3 Results 

We now turn our attention to the following three classes of time-delay systems which 
we will explicitly consider. 

1. x{t) = Aox{t) + Aix{t - t) 

2. = Aoxit) + ^f^, Aix{t - n) 

3. x{t) = Aox{t) + /^^ A{e)x{t + e)de 

Here x{t) G M", Ai G M"^" and A G M"^"[6'] is a matrix of polynomials. These classes 
contain constant, finite aftereffect. We refer to system (T]) as the case of single delay, 
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system as the case of multiple delays and system ^ as the case of distributed 
delay. In this section, we show that in each of these cases, the derivative of the 
complete quadratic functional along trajectories of the system can be represented by 
a quadratic functional defined by the integral and multiplier operators parameterized 
in the previous section. Moreover, the transformation from the coefficients of the 
polynomials defining the complete quadratic functional to those defining its derivative 
is affine. 



7.3.1 The Single Delay Case 

In this section, we consider the first subclass of time-delay systems which are given 
in the following form for matrices A,B G M"^" 



x{t) = Ax{t) + Bx{t - t) 



(7.1) 



The following theorem gives a condition for stability of the system. 

Theorem 89. For integer d > 0, the solution map, G, defined by Equation ()7.1|) is 
asymptotically stable if there exists a constant e > 0, matrix P G S", and continuous 
matrix-valued functions 5 : R ^ Q : R ^ M"^" and i? : R^ ^ M"^" where 
R{9,ri) = R{ri,9)^ and such that 



P-el tQ 



tQ 



T 



T. 



s 



G Gi 



DieGi 



ReGi 



M eGi 



Dm = 

M{e,uj) 



Dn PB-Q{-r) r{A^Q{e) - Q{d) + R{{],e)) 



-S{-r) 



T{B^Q{9)-Ri~T,e)) 
-rS{e) 



'^-R{e,uj) + -^R{e,uj) 



dO dcu 
Du = PA + A^P + Q(0) + Q{Of + 5(0) + el 
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Proof. We use the following complete quadratic functional. 



V{(j)) = 0(O)^P0(O) + 20(0)^ J Q{9)(f){0)d0 

(l){9fS{9)(l){9)d0 + J J (l){9fR{9,uj)(l){uj)d9di 

d9 

(l){9f R{9,uj)4){uj)d9duj + e\\(j){0)\\^ > e||0(O)|p 





0(0)' 


T 


'P-el tQ{9) 




'm 




m 




TQ{9f tS{9) 




m 



fO 



All that is required for asymptotic stability is strict negativity of the the derivative. 
The Lie derivative of this functional along trajectories of the system is given by the 
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following. 



\/(r(0,o)) = 0(o)^p(A0(o) + 

r-O 

'^QiefiA^io) + B<p{-T))de 



r)) + (0(O)M^ +0(_^)^5^)P0(O) 



+ 20(0)^ (^Q(O)0(O) - g(-r)0(-r) 



+ (/.(Of 5(0)(/.(0) - </.(-rf ^(-r 
1-0 

+ / {cp{QfR{^,e)<p{e)-<p{~TfR{-T,e)<p{e))de 

+ / 0)0(0) -0(^)^i?(0,-r)0(-r))rf0 



Q(^)</)(^)(i^j 



<p{dfs{e)(t){d)de 



A-O 



— T ^ — T 



^Rie.uj) + -^R(e,uj) ] <i)iuj)deduj 

dO duj 



m 


T 


0(0) 


<t>{-r) 


Dm 


0(-r) 


m 




0(0) 



A-O 



0(0)M(0,tu)0(cu)d0c/cj-e 



— r — r 



<-4m\? 

Therefore, if the conditions of the theorem hold, then the functional is strictly de- 
creasing along trajectories of the system, proving asymptotic stability. ■ 



7.3.2 Procedure for the Case of a Single Delay 

In this subsection, we explicitly show how the conditions associated with Theorem IH^ 
can be tested using semidefinite programming. As a caveat, we note that direct 
implementation of the procedure presented in this subsection may not be the the 
most numerically efficient method possible. However, from a conceptual standpoint, 
it is the most direct and, in terms of accuracy, will deliver the results contained in 
the numerical examples given later in the text. 
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Problem: Suppose we want to determine whether the following delay- differential 
equation is stable for a certain value of delay, r, using polynomial functions of degree 



Defining Polynomial Veiriables: Our first step is to construct the variables which 
correspond to P and polynomials Q and S. Declaring the scalar variable P should 
be clear. To declare the polynomial matrices Q and S requires that we first construct 
the vector of monomials which are contained in these polynomials. Note that these 
vectors are not variables, rather simply structures which will assist in constructing 
equality constraints. Specifically, let 



Then Q and -S" can be represented using vector variables vq and vs as Q{9) — VqZ^{9) 
and S{9) — VgZ^{9). For convenience, we also put P in vector form, so that P — 



Constructing elements of Gf: For Gf, we declare SOS variable M and polynomial 
variable T. We first declare vector variable vt and define T{9) = v^Z^{9). We then 



x{t) 



ax{t) +bx{t — r) 




vlZ\9), where 



= P 



impose the constraint j_^T{9)d9 = as v'^d' = 0, where 



T l/2r2 



l/3r3 l/4r4 



Since 




To declare SOS variable M, we declare the positive semidefinite matrix variable 
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mjvf > and construct the vector of monomials Z"^. 



where 



zm 

zne) 



1 9 9^ 



We then define M{9) = Z'^{9)'^mMZ'^{9). By construction, M G E^. For future use, 
it will be convenient to write M in vector form. Specifically, let 



M{9) 



'Mii{9) Mi2{9) 
M2i{9) M22{9) 



and 



ruMii rnMi2 

^M21 "^M22 



Now let VMij be the vector of columns of niMij- Then 



M,,{9) = vl,^C,Z\9) 



where 



1 1 

1 1 1 

1 1 



Note: Theorem inni only requires M{9) > for 9 G [— r, 0]. However, by imposing 
the constraint M G S^, we are constraining M{9) > for G R. Although this 
difference should not matter in a technical sense since we only consider the interval 
[— r, 0], in practical terms, this constraint severely restricts the set of admissable 
polynomial functions. For this reason, in implementation, we actually use the set 
r^4, where p{9) = —9(9 + r). In this case, we would declare an auxiliary positive 
semidefinite matrix variable ms > and define M{9) = Z^{9)^mMZ^{9) — 9{9 + 
l)Z'^{9y-msZ'^(9). For simplicity, however, we will not explicitly include ms in our 
discussion. 
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Equality constraints for Gj: We can now impose the constraint 



P-el tQ 
tQ^ tS 



e Gf. 



This is easily done using the vector form of M. Specifically, we include the constraints 



vp-e - fT = vmuCi, vq = VM12C1, and vs = VM22C1. 



Constructing elements of G2' To construct an element of G2, we simply declare 

a positive semidefinite matrix variable rriR and define R{6,uj) = Z^{6)mRZ^{uj). For 
convenience, it will be helpful to represent R in vector form as R{6,lj) = v]^Z^{6,lj), 
where vr is the vector of column vectors of uir and 



1 e 9'' uj 9uj e''uj cu'' 9cu'' e'^u? 



Constructing the Derivative: Recall the derivative is defined D and G, which 
are given by the following. 



P^ + A^P + Q(0) + g(Of + 5(0) PB-Q{-r) T{A^Q{e) - Q{e) + R{Q,e)) 



-S{-r) 



t{B^Q{0)-R{-t,9)) 
-tS{0) 



G{9,u;) = -^R{9,u;) + -^R{9,u;) 



Constructing D and G is relatively easy Decompose D{9) as 



m 



Du D,2 D,3i9) 
*^ *^ D,,{9) 
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Then 



Du = 2Pa+{2vl + vs)Co 
Du ^Pb- vqCr 

D22 = -VsCr 

= vl,,Z\e) = T{hVQ ~ VRCr,l)Z\9) 

= vl23Z\e) = -T{vsCa)Z\e) 



where 



Co = Z\0) 

Cr = Z\-t) = 



1 



1 -T -T^ 





"1 






1 




1 






2 


C'o.i — 




C'r.l — 




3 










4 




1 





— T 
^2 



— T 
^2 



-T 
^2 
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Furthermore, G{6,uj) = v'^{Crd\ + Crd2)Z^{0,^jj) = VqZ^{6,lj), where 



Crdl — 



and Crd2 



Equality constraints for Gl: To impose —D G Gj, we construct positive semidefi- 
nite variable itlk > with and auxihary variables Vun, Vui2, and Vu22 with constraints 
0. We then represent 



rriK 



rriKii rriKu mxis 

*^ mK22 mK23 

T T 

* * mK33 



Furthermore, let Vxij be the vector form of rriKij- Then we impose the following 



constraints. 



- ^"011 = VkuCi - Vuil -Vd12 = VkuCi - Vui2 - Vd22 = VK22C1 - Vu22 

— Vd13 = VKI3G1 —Vd23 = VK23C1 — Vd33 — VK33C1, 

where 



vdu = 


Dn 











Vd12 = 


Du 











VD22 = 


D22 
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Equality constraints for Finally, we constrain G G Gl- For this, we declare 

a new positive semidefinite matrix variable mi > with vector form vl and impose 
the following constraint. 

vg = Vl 

Conclusion Once all the variables and constraints have been declared, the problem 
can be submitted to SDP solvers such as SeDuMi for evaluation. Although the 
problem presented in this subsection is limited in scope, it will hopefully provide 
guidance for those who are interested in understanding the mechanics of the problem. 
For those solely interested in implementing the algorithm at a higher level, there exist 
a number of alternatives. In particular, SOSTools [S2] provides a high-level interface 
to solving sum-of-squares problems. An advantage of this software package is the 
ability to declare polynomial variables and implement constraints using Matlab's 
symbolic math toolbox without creating the explicit matrix maps of the form C 
which were used so prominently in this example. The only drawback to using this 
software lies in the fact that current implementations are somewhat inefficient in 
constructing these constraints and so generally the problem will take much longer 
computationally to set up than to actually solve. For those who would like to simply 
type in a dynamical system and receive an answer, we also suggest the Matlab toolbox 
we have created for solving these types of problems and which can be found online at 
http : / /www . Stanford . edu/~nimpeet/sof tware. 

7.3.3 Examples of a Single Delay 

Example 1: In this example, we compare our results with the discretized Lyapunov 
functional approach used by Gu et al. in JH] in the case of a system with a single delay. 
Although numerous other papers have also given sufficient conditions for stability of 
time-delay systems, e.g. [121 12ZI 1211 , ^^e the approach introduced by Gu since it 
has demonstrated a particularly high level of precision. When we are comparing with 
the piecewise linear approach here and throughout this chapter, we will only consider 
examples which have been presented in the work and we will compare our results 
with the numbers that are cited therein. We use SOSTools [121 SeDuMi [131 
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for solution of all semidefinite programming problems. Now consider the following 
system of delay differential equations. 

xit — r) 

1 oj 

The problem is to estimate the range of r for which the differential equation remains 
stable. Using the method presented in this chapter and by sweeping r in increments of 
.1, we estimate the range of stability to be an interval. We then use a bisection method 
to find the minimum and maximum stable delay. Our results are also summarized in 
Table mi and are compared to the analytical limit and the results obtained in [T^ . 



Our results 


Piecewise Functional 


d 


^min 


Tmax 


N2 




^max 


2 


.10017 


1.6249 


1 


.1006 


1.4272 


4 


.10017 


1.7172 


2 


.1003 


1.6921 


6 


.10017 


1.71785 


3 


.1003 


1.7161 


Analytic 


.10017 


1.71785 









Table 7.1: Tmax and Tmin for discretization level N2 using the piecewise-linear Lyapunov 
functional and for degree d using our approach and compared to the analytical limit 

Clearly, the results for this test case illustrate a high rate of convergence to the 
analytical limit. However, although the results presented here give reasonable esti- 
mates for the interval of stability, they do not prove stability over any interval, but 
rather only at the specific values of r for which the algorithm was tested. To provide 
a more rigorous analysis, we now include r as an uncertain parameter and search 
for parameter dependent Lyapunov functionals which prove stability over an interval. 
The results from this test are given in Table 17.31 

Example 2: In this example, we illustrate the fiexibility of our algorithm through 
a simplistic control design and analysis problem. Suppose we wish to control a simple 
inertial mass remotely using a PD controller. Now suppose that the derivative control 
is half of the proportional control. Then we have the following dynamical system. 



x{t) 



1 

0.1 



x{t) = —ax{t) — —x{t) 
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d in T 


d in 6 


^min 


^max 


2 


2 


.1002 


1.6246 


2 


4 


.1002 


1.717 


Analytic 




.10017 


1.71785 



Table 7.2: Stability on the interval [rmin, Tmax] vs. degree using a parameter-dependent 
functional 

It is easy to show that this system is stable for all positive values of a. However, 
because we are controlling the mass remotely, some delay may be introduced due to, 
for example, the fixed speed of light. We assume that this delay is known and changes 
sufficiently slowly so that for the purposes of analysis, it may be taken to be fixed. 
Now we have the following delay-differential equation with uncertain, time-invariant 
parameters a and r. 

x{t) = —ax{t — t) — 2^{t — t) 

Whereas before the system was stable for all positive values of a, now, for any fixed 
value of a, there exists a r for which the system will be unstable. In order to determine 
which values of a are stable for any fixed value of r, we divide the parameter space 
into regions of the form a G [amin,amax] and r G [Tmin, Tmax]- This type of region is 
compact and can be represented as a semi-algebraic set using the polynomials pi{a) = 
) and P2{r) = (r 

^min ''"max 

). By using these polynomials, we 
are able to construct parameter dependent Lyapunov functionals which prove stability 
over a number of parameter regions. These regions are illustrated in Figure mi 



PD control with delay 




control gajn(a) 



Figure 7.1: Regions of Stability for Example 2 
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We now consider the case of multiple delays. The system is now defined by the 
following functional differential equation where Ai G R"^", Xj > rj_i for i = 1, . . . , K, 
and To = 0. 

K 

x{t) = Y,Ax{t-Ti) (7.2) 

i=0 

The difference between the analysis of the case of a single delay and that of multiple 
delays is that the matrix-valued functions defining the complete quadratic functional 
necessary for stability may now contain discontinuities at discrete points given by the 
values of the delay. In this case, we express the the complete quadratic functional in 
the following form where Qi : M ^ M"^", : M ^ §" and Rij : _^ M"^" for j = 
1, . . . ,K are continuous matrix-valued functions, P G §" and Rij{9, u) = Rji{uj, 9)^. 

K _ 
j=l J-n 

+ ^ ' (t){dY Si{e)(t){e)de + I ' j ' ' (f){efRij{e,uj)(f){uj)deduj 

j = l •^-'^i i=l j = l J -"^i J -"^3 



Theorem 90. For integer d > 0, suppose P e S"^ , t] > 0, Qi : R M"''", S'i : M ^ 
and Rij : R*^^" where Rij{6, uj) = Rji{uJ, O)"^ are continuous for i, j = 1, . . . , K . 

Let R{6,uj) = Rij{d,uj) for 6 E li, uj E Ij where Li = [—Ti, —Ti_i]. Then the solution 
map defined by equation ()7.2p is asymptotically stable if the following holds. 

M eGf ReGi 
-DeGi LeGi 
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M{9) 



p-i]i TQ,{e) 



L{e,uj) = —Rij{e,uj) + —Rij{e,uj) eeii,uje ij 



fore eh 



Dll tD120) 
rD12i{ef TD22i{e) 

L>lln = PAo + A'^P + Qi{0) + Qi{Of + Si{0) - r]I 



PAi_i - Qi_^{-Ti_^) + Qi{-Ti_i) i,j = l,2...K 
PAk-Qk{-tk) i,j^l,K + l 

-SKi-TK) i=j=K+l 

otherwise 

Di2Ae) = 

R^,{Q,e) + AlQ,{e)-Q,{e) 

R2j{-ru e) - Rij{-n, 9) + AlQj{e) 
R(K)j{-rK-i, 0) - R(K-i)j{-rK-i, 0) + A'j^_^Qj{9) 

AiQj{e)-RKj{-TK,e) 

D22i{0) = -Si{e) 
Proof. We use the following complete quadratic functional. 



1 /-^ 

^ J-TK 



0(0) 

m 



M{9) 



0(0) 

m 



+ r r HOfR{0,u)<P{u)dedu; + rj\\mf>v\\mf 

The system is asymptotically stable if the derivative of the functional is strictly 
negative. The Lie derivative of the functional along trajectories of the systems is 
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given by the following. 



v^(r(0,o)) 





T 






m 














. ^^^^ . 



d9 



+ 



L{6^ uj)(l){uj)d6duj — rj 



< —7] 



Thus if the conditions of the theorem hold, then the derivative of the functional is 
strictly negative, which implies asymptotic stability. ■ 



7.3.5 Examples of Multiple Delay 

Example 3: Consider the following system of delay-differential equations. 

xit) = 

Again, the system is stable when r lies on some interval. The problem is to search 
for the minimum and maximum value of r for which the system remains stable. In 
applying the methods of this chapter, we again use a bisection method to find the 
minimum and maximum value of r for which the system remains stable. Our results 
are summarized in Table 17.31 and are compared to the analytical limit as well as 
piecewise-linear functional method. For the piecewise functional method, N2 is the 
level of both discretization and subdiscretization. 



-2 


x{t) + 


-1 






. 10. 






-1 -1 





1 / r, 19 , 

— x{t H x{t — r 

20 ^ 2^ 20 ^ ^ 



7.3.6 Distributed Delay Case 

We now consider the case of distributed delay where the dynamics are given by the 
following functional differential equation where Aq G M"^" and A G M"^"[0]. 

x{t) = Aox{t) + / A{9)x{t + 9)d9 (7.3) 
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Our Approach 


Piecewise Functional 


d 


''"min 


''"max 


N2 


''"min 


''"max 


2 


.20247 


1.354 


1 


.204 


1.35 


4 


.20247 


1.3722 


2 


.203 


1.372 


Analytic 


.20246 


1.3723 









Table 7.3: r^ax and Tmin using the piecewise-linear Lyapunov functional of Gu et al. 
and our approach and compared to the analytical limit 



We can again assume that the matrix- valued functions defining the complete quadratic 
functional are continuous. This leads to the following theorem. 



Theorem 91. For integer d > 0, the solution map, G, defined by equation ()7.3j) is 
asymptotically stable if there exists a constant rj > 0, a matrix P G §" and matrix 
functions Q : R ^ M"^", S : M ^ i? : _^ M"^" where R{9, u) = R{uj, Of and 
such that the following holds 



where 



P-ril tQ 

tQ'' rS 

ReGi 



G Gi 



-D G Gi 



M eG" 



m = 

Dn = 

Dl2{0) 



Dii + ril tDu{0) 

TDuief -rS{e)_ 

PAo + AlP + Q{0) + Q{Of + S{0) -Q{-r) 
-Qi-rf -S{-r) 

AlQie) + PAie) - iQiO) + Rio 

-Ri-T,e) 



M{9, u) = ^Rie, uj) + ^Rie, uj) - A{9fQ{uj) - QiefAiuj) 
dO du) 



7.4. CONCLUSION 
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Proof. We consider the complete quadratic functional 
V{<P) 



+ 



rO 



c 


'm 


T 


'P-ril rQ{9) 




'm 








TQ{ef TS{e)_ 







de 



^{efR{e,uj)^{uj)dedu + r]U{{))\\'' > v\\Ho)\\' 



The system is asymptotically stable if the Lie derivative is strictly negative. The Lie 
derivative of the functional along trajectories of the system is given by 



r-O 



m 


T 


m 




0(-r) 


m 


0(-r) 


de 


m 




m 





m^M{e,u;)<l>{u;)du;de-ri\\m\\' < -vWmW 
Thus, if the conditions of the theorem hold, then the system is asymptotically stable. 



7.4 Conclusion 

In this chapter, we have shown how to compute solutions to an operator-theoretic 
version of the Lyapunov inequality. Our approach is to combine results from real alge- 
braic geometry with functional analysis in order to parameterize certain convex cones 
of positive operators using the convex cone of positive semidefinite matrices. We then 
show that the operator inequalities can be expressed using affine constraints on these 
matrices. This allows us to compute solutions using semidefinite programming, for 
which there exist efficient numerical algorithms. We have further extended our results 
to the case when the dynamics contain parametric uncertainty using a construction 
based on certain results of Putinar and others. The numerical examples given in this 
Chapter demonstrate a quick convergence to the analytic limit of stability. 
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We conclude by mentioning that the methods of this chapter can be used to con- 
struct full-rank solutions of the Lyapunov inequality. Furthermore, we have developed 
methods for constructing the inverses of these full-rank operators. By computing so- 
lutions to the Lyapunov inequality for the adjoint system constructed by Delfour and 
Mitter |S], this invertibility result seems to imply that one can construct stabiliz- 
ing controllers for linear time-delay systems. This work is ongoing, however, and is 
therefore not detailed in this thesis. 



Chapter 8 

Stability of Nonlinear Time-Delay 
Systems 

8.1 Introduction 

The question of stability of nonlinear functional differential equations is complicated 
by the lack of a complete Lyapunov functional structure whose existence is necessary 
for stability of a general nonlinear time-delay system. For this reason all results given 
in this section will only be sufficient. Furthermore, we cannot claim, as was done 
in the previous chapter, that these conditions will generally approach necessity in 
any sense. Given these limitations, we felt that the best approach was to construct 
a sequence of conditions that would approach necessity in at least one special case, 
that of linear systems. For this reason, the conditions presented in this chapter are 
a generalization of those in the previous one and the Lyapunov functionals reduce to 
the complete quadratic functional in the case where the degree of x is restricted to 
2. This chapter differs from the presentation of the linear case in that it includes a 
section on delay-independent stability, a topic not previously discussed. 
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8.2 Delay-Dependent Stability 

Consider a nonlinear discrete time-delay system defined by a functional of the follow- 
ing form for Tj < Ti_i for i = 1, . . . , K and Tq = 0. 

f{Xt) = f{x{t),x{t -Ti),--- ,x{t- Tk)) 

In this section, we present conditions for stability based on the use of a gener- 
alization of the compete quadratic functional. The generalized Lyapunov functional 
has the following form. 





T ] 



v{4>) := / z,[0(o), mv M{9)Za[m. m]do 

J -TK 

/O j-0 
/ Zd[4>{e)]^R{e,uj)Zd[<p{uj)]deduj 
-Tk J -tk 

8.2.1 Single Delay Case 

In this subsection, we consider the special case of a single delay. 

X{t)^ f{x{t),x{t-T)) 

Here we assume x{t) e and / is continuous. We first introduce some notation. 

Definition 92. We say a continuous function f : M^"^ x M M satisfies f E Ki if 
there exists some a > such that the following holds for all 4> E Cr- 

' f{m,m,o)d0>a\\mf 

-T 

Definition 93. We say a continuous function f : M^" x ^ M satisfies f E K2 if 
the following holds for all (p & Cr- 

pO 

/ f{(p{9),(f){u),9,u)d9du>0 

-T J —T 
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Definition 94. We say a continuous function f : M^" x M — M satisfies f G if 
there exists some a > such that the following holds for all (j) E Cr- 

' f{mA{-r)A{0),d)de>a\\m\? 

■T 

The sets Ki, K2, and are used to define a positive Lyapunov functional and 
some of its derivative forms. For a given degree bound, these sets can be parameterized 
by the space of positive semidefinite matrices using the following subsets. 

Definition 95. Denote f E G Ki if f is a polynomial of degree d or less such 
that there exists a polynomial function t : M" x M — > R, of degree d or less, and a > 
such that the following holds. 

f{xi, X2, 9) — t(xi, 6) — a;||a;i|p G 
t{xi,e)de = 



Definition 96. Denote f G ^2"^ G K2 if f is a polynomial of degree 2d or less 
and there exists a polynomial matrix function i? : — >■ m( ) ^ ( ) such that R G 
Gf^ (defined in Chapter^ and the following holds. 

/(xi, xi, e, iu) = Za{x,fR{e, uj)Zd{x2) (8.1) 

Definition 97. Denote f G G if f is a polynomial of degree d or less such 
that there exist polynomial function t : M^" x M ^ M, of degree d or less, and a > 
such that the following holds. 

f{xi,X2,X3,6) - t{xi,X2,6) - a\\xi\\^ G 
j t{xi,X2,6)d9 = 

We now state the stability theorem. 
Theorem 98. For a given integer d > 0, suppose there exist functions g G Sf, 
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h,h & and —g e Sg such that the following conditions hold. 

g{xt{o),xt{-T).xt{e).e) 

= g{xt{0),xt{0), 0) - g{xt{0),Xt{-T), -r) 

+ rV,,^o)9ixtiO),Xti9), 9)^ f{xtiO), Xti-r)) r—g{x,{0), Xt{9), 9) 

+ Th{xt{Q),Xt{9), 0, 9) - Th{xt{-r),xt{9), -r, 9) 

+ Th{xt{9),xm, 9, 0) - rh{xt{9),xt{-r), 9, -r) 

S S 
h{xt{9),xt{uj),9,uj) = —h{xt{9),xt{uj),9,uj) + —h{xt{9),xt{uj),9,u) 

Then the time-delay system defined by f is globally asymptotically stable. 
Proof. Consider the Lyapunov functional defined as follows 

g{xt{0),xt{9),9)d9 + J J h{xt{9),xt{u;),9,u)d9du; > a\\xt{0)f 

The derivative of this functional along trajectories of the systems can be expressed 
as follows. 

V{xt) ■.^g{xt{0),xt{0),0) - g{xt{0),Xt{-T),-T) 

{'^M0)9{xt{0),xt{9),9fp{xt{0),xt{-T)) - j^g{xt{0),xt{9),9)y9 

+ (^h{xt{0),xt{9),0,9) - h{xt{-r),xt{9),-T,9)y9 

+ (^hixt{9),xt{0), 9, 0) - h{xt{9),x,{-T), 9, -r)) d9 
5 



—h{xt(9),xt(u;),9,u;) + —h(xt(9),Xt(u;),9,u;)^d9du; 



69 ^ 'V ^' ' ^ ' Suj 

g{xt{0),xt{-T),xt{9),9)d9+ I I h{xt{9),xt{uj),9,uj)d9duj 



1 

T 

|2 



<-a\\xtmi 

Thus, we have that if the conditions of the theorem are satisfied, then the derivative 
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of the Lyapunov functional is negative definite, proving global asymptotic stability of 
the functional differential equation defined by /. ■ 

As with the linear case, the conditions contained in Theorem 1981 can be expressed 
semidefinite program. 

8.2.2 Multiple Delays 

In this section, we consider stability of nonlinear time-delay systems defined by func- 
tionals of the following form for < rj_i for i = 1, . . . , K and tq = 0. 

X(t) = f{x(t),x{t - Ti), ■ ■ ■ ,x(t- Tk)) 

As before, x{t) G M", / is continuous, and we introduce some notation. 

Definition 99. We say a function f : M^" x M ^ M satisfies f G Ki if f{xi, X2, 0) is 
continuous except possibly at points 9 E {— Tj}^Y^ ^''^^ there exists some a > such 
that the following holds for all cf) E Cr- 

f{m,m.o)dd>a\\m\? 

Definition 100. We say a function / : M^xM^ ^ M satisfies f E K2 if f{xi,X2,6,uj) 
is continuous except possibly at points 9,cu E {—Ti}^^ and the following holds for all 
E Cr. 

/ f{(l){9),^{uj),e,uj)d9duj>0 

-TK J -TK 

Definition 101. We say a function f : x M ^ M satisfies f E K3 if f is 

continuous except possibly at points 9 E {— Ti}^]^ and there exists some a > such 
that the following holds for all (p E Cr- 

/(0(O), 0(-ri), ■ ■ ■ , <P{-tk), 0)d9 > a\\m\\' 

■TK 

The sets Ki, K2, and K3 are used to define positive Lyapunov functionals and 
some of its derivative forms in the case of multiple delays. For a given degree bound. 
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these sets can be parameterized by the space of positive semidefinite matrices using 
the following subsets. 

Definition 102. Denote f E C Ki if there exist polynomial functions fi : x 
W ^ W, ti : X R ^ R, i ^ 1 ■ ■ ■ K of degree d or less and a > such that the 
following holds for all e R". 

fi{xi,X2,0) - ti{xi,9) - q;||xi|P e 

f{xi, X2, 9) = fi{xi, X2, 9) \/9 e [-Ti, -Ti-i] 

'z— 1 



i=l 



ti{xi,9)d9^0 



Definition 103. Denote f G S'^'^ C K2 if f is a polynomial of degree 2d, or less such 
there exists a matrix function i? : ^ ]r( ) ^ ( d ) such that R e Gl'^ and the 
following holds. 

f{xi,Xi,9,uj) = Zd{xifR{9,uj)Za{x2) (8.2) 

Definition 104. Denote f eE^C if there exist functions fi : M"(^+2) x M M, 
ti : M"(^+2) xR^R, i — 1---K, of degree d or less, and a > such that the 
following holds. 

fi{xi,--- ,Xk+i,Xk+2,9) -ti{xi,--- ,Xk+i,9) -q;||xi||^ G 

f{xi, ■■■ , xk+1, xk+2, 9) = fi{xi, ■■■ , xk+1, xk+2, 9) V6I e [-Ti, -Ti_i] 

^ / ti{xi, • • • , Xk+1, 9)d9 = 

i=l ''-'^i 

We now state the stability theorem in the case of multiple delays. 

Theorem 105. For a given integer d > 0, suppose there exist functions h G Sf, 
g,g E S2, and /i G S3 such that the following conditions hold where li := [—Ti, — rj_i] 
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and Atj := Tj — Tj_i. 

= gi{xt{0),xt{-Ti-i), -Tj-i) - gi{xt{0), xt{-Ti), -n) 

K 

^^{hij{xt{-Ti^i,Xt{0), -Tj_i,6l) - hij{xt{-Ti),Xt{9), -Ti,e)^ 

K 

+ ^(hji{xt{e),Xt{-Tj_i),9, -Tj_i) - hji{xt{9),Xt{-Tj),9, -tj)^ 
i=i 

6 6 
hij{xt{9),xt{u),9,uj) = —hij{xt{9),xt{u),9,u;) + —hij{xt{9),xt{u;),9,u) 

Where 



ATMM0),xt{9),9) ■.= g{xt{0),xt{9),9) ^9 e I, 

gi{xt{0), ■■■ , xt{-TK), xt{9), 9) := g{xt{0), ■■■ , xt{-TK),xt{9), 9) \/9 e /j 
hij{xt{9),xt{uj),9,uj) -.^ h{xt{9),xt{uj),9,uj) \/9,u e h 
hij{xt{9),xt{ou),9,u) -.^ h{xt{9),xt{ou),9,u) W,^ e h 



Then the time-delay system defined by f is globally asymptotically stable. 
Proof. Consider the Lyapunov functional defined as follows. 



V{xt):= I g{xt{Q),Xt{9),9)d9+ f ! h{xt{9),xt{uj),9,u)d9duj 
= 11 I ' ^ngi{xt{0),xt{9),9)d9+Y^ [ f ' ' hij{xt{9),xt{u;),9,uj)d9dw 

i=l •'-'^i Li=l •'-■^i -'-■^3 



|2 



>«lkt(o)ih 

The inequality holds for some a > by definition of the set Ki. The derivative of 



96 CHAPTER 8. STABILITY OF NONLINEAR TIME-DELAY SYSTEMS 

this functional along trajectories of the system can be expressed as follows. 

K 

V{xt) ■■= ^ Ari(^5(i(xt(0),Xt(-ri_i), -ri_i) - gi{xt{0), Xt{-Ti), -Ti)^ 
1=1 

+ E / (v,,^o)9^{xt{o),x,{e), effixtio), xt{-TK)) - j^g.{xt{o),xt{e), e))de 

+ ^ / (^/iij(xt(-rj_i,xt(cj), -rj_i,c^) - /ijj(a;i(-rjO,Xt(c^), -rj,cj)jrfw 
+ ^ / f/iij(xt(6'),xt(-ri_i),6', -ri_i) - /iij(xt(6'),xt(-ri),6', -rj)jrf6' 

/ /iij(xt(6'),xt(c^),6',t^) + — /iij(xt(6'),xt(t^),6',u;)j(i6'rfcu 

1 r-n-i 
= — giixt{0), ■ ■ ■ , Xt{-TK),Xt{9), 9)d9 

+ ^ / / hij{xt{9),xt{uj),9,uj)deduj 

g{xt{0),--- ,Xt{-TK),9)d9+ / / h{xt{9),xt{uj),9,uj)d9duj < -a\\xt{0)f 



— r ^ — r 



The final inequality follows from the definition of K2 and K^. Thus the conditions of 
the theorem imply global asymptotic stability of the time-delay system defined by /. 



Similar to the case of a single delay, the conditions of Theorem 11051 can be ex- 
pressed semidefinite program. 



8.3 Delay-Independent Stability 



We now briefly discuss conditions for delay-independent stability of time-delay sys- 
tems. Recall that a system defined by a functional of the following form is stable 
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independent of delay if it is stable for any finite values of {tj}^^. 

f{Xt) ■= f{Xt{Q),Xt{-Ti), ■■■ , Xt{-TK)) 

Here we assume / is continuous and x{t) e W^. The theorems of the previous 
section can be applied directly to the problem of delay-independent stability by con- 
sidering Ti to be an uncertain parameter and searching for a parameter-dependent 
Lyapunov functional. However, a less computationally intensive approach is to con- 
sider specific Lyapunov functional forms where does not explicitly appear in the 
stability conditions. One such Lyapunov functional form is given as follows. 

v{ct>)=po{m) + Y. / PiW))de 

This functional has an upper Lie derivative defined as follows. 

K 

1/(0) - Vpo(0(O)r/(Xi(O),X*(-Ti), • • • ,Xi(-T^)) + J]p,(0(O)) -P2(0(-T,)) 

i=l 

Since does not appear explicitly in the derivative of the functional, we can prove 
stability for arbitrary Tj using the following theorem. 

Theorem 106. For a given integer d, suppose there exist polynomials {pi}^Q and 
constant a > such that Pi{0) = for i — 0, . . . , K and the following conditions hold. 

Po{xo) - a\\xo\\^ e 

P^{x^)eI:t 1 = 1,. ..,K 

K 

- Vpo{xo)'^f{xo,xi, ■■• ,xk)- ^(^Pi{xo) -P2{xi)j - aWxoW^ e 

i=l 

Then the system defined by f is globally asymptotically stable for any finite values of 

n- 
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Proof. Consider the following Lyapunov functional. 




The Lyapunov functional is positive definite by the conditions of the theorem. The 
derivative of the functional along trajectories of the system is given as follows. 

K 



V{<P) = Vpo(0(O))^/(Xt(O), Xt{-n), ■ ■ ■ , Xt{-TK)) + 5^P.(0(O)) - P2{<P{-T.d) 



Therefore the derivative is negative definite by the conditions of the theorem. There- 
fore we have that the system defined by / is globally asymptotically stable for any 



The computational burden associated with the conditions expressed in Theo- 
rem I1U6I is significantly less than that associated with proving delay-independent 
stability using Theorem 11051 This reduction occurs because in this case, we have 
deliberately chosen a Lyapunov functional structure where the delays do not ex- 
plicitly appear in the derivative. Naturally, the use of a more specialized Lyapunov 
functional structure may result in an increased level of conservativity. For this rea- 
son, when testing delay-independent stability, it is recommended that Theorem 11061 
be used as a first approximation and that Theorem llOSI be used if additional accuracy 
is required. 

8.3.1 Numerical Examples 

The contribution of this chapter is to show that Lyapunov functions to prove stability 
of arbitrary non-linear polynomial systems may be computed algorithmically. To 
illustrate this, we compare our results with those derived through less algorithmic 
analysis. 

Example 1: Reflection Dynamics 



i=l 



< -«lkt(o)f 



finite values of Tj. 
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Figure 8.1: Example of a trajectory of x{t) for a = —1, b = .9 




Figure 8.2: Example of a trajectory of V{xt) for a = —1, b = .9 

To begin, we compare our results with a solution given by Hale 14j and attributed 
to LaSalle for the following dynamics. 

x{t) = ax^{t) + bx^{t-T) (8.3) 

The following Lyapunov function is used by Hale to show that the system is stable 
for any a < 0, |6| < \a\. 

F(x,) = -^ + £xl{e)de (8.4) 

Our own computation of various points give similar results. For example, for 
a = —1, b = .9, we can prove asymptotic stability using the following function 

V{xt) = -3.92x^(0) + 1.91x^(0) + / 5.35xf{9) + 3.72xl{9) dO 
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The purpose here is not to construct this particular Lyapunov function, but rather 
to demonstrate that such functions can be numerically computed without the insight 
needed to manually derive the results. To illustrate this expanded flexibility, suppose 
we introduce a cross-term, such as might arise due to interference, then we have 

x{t) = ax^it) + c{x{t)x{t - T)f + hx^it - t) (8.5) 

We find the following Lyapunov function in the case when a = —1, b = 0.5, c = 0.2. 

V{xt) =4.233x^^(0) - 0.2147x^^(0) 

+ 1.8564(0) / A.107xt{e) + 0.1525xj^(^) + 3A54x%e) dO 

Example 2: Epidemiology 

We now consider the following epidemiological model. Consider a human popu- 
lation subject to non-lethal infection by a virus. Assume the disease has incubation 
period r. Cooke P models the percentage of infected population, y{t) using the 
following dynamics. 

y(t) = -ay(t) + 6y(t-r)(l-y(t)) 

Where 

• a is the recovery rate for the infected population. 

• 6 is the rate of infection for those exposed to the virus. 

The model is nonlinear and equilibria exist at = and y* = {b — a)/b. Cooke 
used the following Lyapunov functional to prove delay-independent stability of the 
equilibrium for a > 6 > 0. 

Using semidefinite programming, we were also able to prove delay-independent 



8.4. CONCLUSION 



101 



stability for a > 6 > using the following functional. 

V{^) = 1.750(0)^ + / (1.47a + .2%h)<p{df dd 

The point of these examples is obviously not to trivialize the work of Cooke and 
Hale, but rather to show the broad applicability and utility of the algorithms presented 
in this thesis. 

8.4 Conclusion 

This chapter provides a generalization of the stability analysis results for linear time- 
delay systems presented in Chapter [7| to the case of nonlinear dynamics. To this end, 
we have proposed a sequence of sufficient conditions for both delay-dependent and 
delay independent stability of nonlinear systems with multiple delays. The numerical 
examples presented illustrate that many previous results on stability analysis can be 
derived using our algorithmic framework. Unfortunately, unlike in the linear stability 
case, we are not optimistic that the results of this chapter will lead to algorithms 
for the construction of stabilizing controllers for any broad class of nonlinear time- 
delay systems. This is because the results of this chapter to not fit as neatly into the 
operator-theoretic framework of the linear case. 



Chapter 9 



Conclusion 



The purpose of this thesis has been to find ways of addressing the question of sta- 
bihty of complex systems. In particular, we have sought ways of using results from 
functional analysis, real algebraic geometry and computer science to provide new 
approaches to answering the question of stability of nonlinear differential equations 
which contain delay. The results can be divided into two different approaches. 



9.1 Generalized Passivity 

In Chapter we showed how one can restructure the stability question of a nonlinear, 
discontinuous model of internet congestion control which contains delay. We showed 
how the question of stability of the model could be recast as the question of passivity of 
each of two interconnected operators. We then showed that by choosing to decompose 
the system into simpler subsystems, one of which is nonlinear and discontinuous 
but delay free and the other which is linear, but contains delay, one can use more 
specialized tools on each subsystem. By using more specialized tools, we were able to 
obtain less conservative results for each subsystem. We then combined these improved 
bounds using the generalized passivity framework to obtain less conservative results 
for the combined system. 



102 



9.1. GENERALIZED PASSIVITY 



103 



Practical Impact There are a number of factors to consider wlien evaluating the 
practical impact of this work on stability of Internet congestion control. As mentioned 
earlier, it has been shown that current internet protocols will destabilize as transmis- 
sion rates and link capacities continue to increase. Finding a stable alternative to 
current protocols which converges to a global optimum is therefore a high priority for 
researchers. In addition, because of the broad geographic reach of the internet, one 
should expect to find that transmission delay will be a major consideration for any 
future internet design. In particular, a simple calculation reveals that the speed of 
light alone can account for a round-trip delay of .1 seconds or more. It is well-known 
to the practicing engineer that such delays will have a destabilizing effect on most 
control systems at high values of gain. An alternative version of internet congestion 
control which specifically attempts to account for these delays is the FAST protocol 
which has presented in this paper. It has been shown that the FAST protocol is stable 
about the equilibrium for arbitrary topology and delay. 

The work in this paper has shown that the FAST protocols are also stable globally 
for a more limited network topology. This work is important in that it shows, for 
the first time, that the protocols developed for the linearized system also converge 
in the nonlinear setting without additional constraints on the parameters. From a 
practical standpoint, the improvement of 57% in the gain parameter a over the best 
available previous bound should allow a substantial increase in the rate of convergence 
to the global optimal. Since the internet is generally a dynamic environment, quick 
convergence of the system to equilibrium is of particular importance. In addition, the 
increase in a also results in a 37% decrease in the equilibrium value of the price. Since 
price tracks queue length in most implementations, this result gives a 37% decrease in 
size of the equilibrium queue. This results in a decrease of the storage space needed at 
the queues and therefore cost savings for providers of routers. However, we note that 
for this increase in the gain parameter to be implemented throughout the internet, 
one would like to see an extension of our results to the general network topology. 

Research Directions As we mentioned in Chapter the proof we have given in 
the limited topology framework is not easily extended to the more general case. The 
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reason for this is that the dynamics at the hnk are nonhnear due to the discontinuity 
due to the positive projection. The approach in this thesis was to separate the 
nonhnearity from the delay. Ideally in the multiple-user /multiple-link framework, we 
would also separate the nonhnearity and delay so that we would be left with the 
feedback interconnection of multiple nonlinear subsystems and multiple linear, but 
delayed subsystems. However, the presence of nonhnearity at the link makes this 
approach problematic. To date, we have not overcome this difficulty. 

Another extension of this work is the use of our methods to consider alternative 
versions of internet congestion control. Almost any protocol should be amenable 
to this type of analysis provided that the nonhnearity satisfies a sector bound. In 
addition, if one analyzes a linear source control with a nonlinear, discontinuous link 
control, then the problems discussed earlier are lessened and extensions to the general 
network topology are more likely to be found. 

9.2 Algorithms for Stability Analysis 

In Chapter [71 we showed how the question of stability for linear time-delay systems 
could be posed as the search for a positive complete quadratic Lyapunov functional 
with negative derivative. We then explained how the search for such a functional 
could be expressed as a convex feasibility problem over certain convex cones of posi- 
tive linear operators. We then demonstrated that if one considers the subset of such 
operators which are defined by polynomials of bounded degree, then the search for 
such operators can be expressed using semidefinite programming constraints. This 
allowed us to express the question of stability of linear time-delay systems as a semidef- 
inite programming problem which is amenable to solution using recently developed 
interior-point methods. In addition, we were able to generalize this approach to linear 
systems with parametric uncertainty. In Chapter |H1 we were able to further generalize 
this approach to nonlinear time-delay systems through the use of non-quadratic Lya- 
punov functionals. We also dealt with the particular case of delay-independent stabil- 
ity using a particular form of Lyapunov functional for which the resulting semidefinite 
program was of significantly decreased complexity. 
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Practical Impact The practical impact of Chapters [7| and |H1 is to show how sta- 
bility proofs for a broad class of time-delay systems can be computed quickly and 
efficiently using existing numerical algorithms. In particular, by using Matlab pack- 
ages such as SOSTools, the equality constraints implied in the stability theorems can 
be implemented quickly using a minimal amount of coding. The semidefinite program 
can then be solved efficiently using interior-point algorithms such as that in SeDuMi 
and its Matlab interface. 

In addition, for the linear case at least, the size of the semidefinite programs 
associated with the various stability theorems scales well in the size of the problem. 
In particular, for a n-dimensional single-delay system using polynomial functions of 
degree 2d, the number of variables scales as {n- d)"^. For a n-dimensional system with 
i^-delays using polynomial functions of degree 2d, the number of variables scales as 
{n ■ d ■ Ky. When parametric uncertainty or nonlinearity are present, however, the 
scaling becomes much worse. In particular, for the case of a linear n-dimensional 
system with i^-delays using polynomial functions of degree 2d, and m uncertain 
parameters at using polynomials of degree 2^2 in a^, the number of variables scales 
as {n.d-K.{"^X'^)Y. 

In engineering practice, of course, there are many ways that one can deal with the 
presence of delays. For example, in designing controllers, it is standard to use a Fade 
approximation to replace the transcendental term in the characteristic equation with 
a rational polynomial. This rational transfer function can then be controlled using 
standard techniques. In general, however, such controlled systems are not guaranteed 
to be stable unless the system also satisfies some additional restrictions including 
bounds on size of the delay and bandwidth restrictions on the input. For analysis, 
the advantage of our method over direct use of the Fade approximation lies in the fact 
that our method guarantees stability regardless of dynamic properties of the system. 
Moreover, if one considers the question of control, then our approach can be seen 
more as a complement to use of the Fade approximation, since the one method can 
be used to efficiently design controllers while the other can be used to verify stability 
of such controllers. 

In addition to direct use of the Fade approximation, there exist methods which 
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attempt to use a rational approximation for the delay and combine this with some 
parametric uncertainty to give conditions which are guaranteed to prove stablity. Fur- 
thermore, there exist bounds [M] on how well this Fade technique approximates the 
original system as a function of the degree of the approximation. Unfortunately, the 
conditions associated with this approach require the user to solve certain parameter- 
dependent LMI problems. The advantage of our approach in this case is to give 
an explicit numerical procedure for computing stability which involves a minimum 
amount of effort by the user. 

Finally, we conclude this section by mentioning perhaps the most important ad- 
vantage of our algorithm over previous existing methods. This advantage lies in the 
ability of the algorithm to adapt to numerous forms of generalization beyond the 
linear fixed-delay result. In particular, our methods can be used to construct a broad 
class of Lyapunov functionals for analysis of nonlinear and uncertain time-delay sys- 
tems. For such systems there exist very few analysis tools, making our algorithm 
stand out simply due to the lack of competition. 

Research Directions The work in this thesis on computation of Lyapunov func- 
tionals for time-delay systems provides a number of exciting directions for further 
research. If one views the results in the linear case as an attempt to generalize prior 
work on finite-dimensional linear operator theory to infinite dimensions, then perhaps 
the most obvious next step is to derive conditions for the synthesis of stabilizing con- 
trollers. In particular, we have recent results that show how to construct the inverse 
operators to the combined multiplier and integral operators which define the complete 
quadratic functional. If we rely on the analogy of linear finite-dimensional systems, 
then this result should allow us to directly synthesize stabilizing controllers. Unfortu- 
nately for linear time-delay systems, however, the dual to the linear time-delay system 
is not a linear time-delay system. Thus the most obvious route for this research would 
seem closed to us. Fortunately, however, the work by Delfour and Mitter |H], among 
others, has shown us that instead of analyzing stability of the dual system, we may 
consider stability of the adjoint problem which is itself a linear time-delay system. 
Furthermore, this adjoint system has stability properties that are directly related 
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to that of the original system. However, further work in this direction is necessary 
before making any stronger assertions. Apart from stabihzation, other possible gen- 
eralizations of finite-dimensional linear theory include optimal control, filtering and 
an operator-theoretic version of the KYP lemma for transcendental polynomials. 

Another direction for this research is to consider more general classes of infinite- 
dimensional systems. In particular, some classes of partial differential equations are 
also amenable to analysis using Lyapunov functional methods. Thus it may be pos- 
sible in some cases to derive stability proofs for these types of systems. In particular, 
the question of stability of the Navier-Stokes equation is a subject of considerable 
interest. While we are far from claiming that this question is a straightforward gen- 
eralization of our methods, we do not discount the possibility that it may eventually 
fall within the scope of algorithmic analysis. Generally, however, in order to study 
stability of a class of differential equation, one must be able to structure the deriva- 
tive of the Lyapunov functional in such a way that its negativity can be verified using 
semidefinite programming. In the case of linear time-delay systems, the derivative of 
the Lyapunov functional could be structured in a way which was similar to that of 
the functional itself. For this reason, conditions for negativity of the derivative were 
a simple generalization of the conditions for positivity of the functional and there- 
fore expressing the conditions for stability as a semidefinite program was relatively 
easy. In general the same may not be true for larger classes of system. We do have 
some reason to be optimistic, however, since the case of linear time-delay systems is 
actually structured in a rather complicated manner and showing how to restructure 
the derivative of the functional was, in fact, not trivial. Less structured types of sys- 
tems may, in fact, be easier to analyze. However, without further research we cannot 
provide a more definitive answer to this line of inquiry. 

Apart from further developments in theory, perhaps the most important research 
direction is application of the algorithms presented in this thesis to practical problems. 
Systems with nonlinearity and delay arise in a number of different disciplines. In 
particular, modeling of biological phenomena has show that many aspects of the 
natural world are dominated by nonlinear and infinite-dimensional behavior. Much 
recent research effort has been put into modeling these type of system and as more 
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models arise, one can project the need for more efficient ways of analyzing them. 
Thus we are considerably interested to see if the techniques proposed in this thesis 
can find use in applications as diverse as determining effectiveness of cancer therapy 
or the ability of the immune system to compensate for the constantly changing genetic 
makeup of viruses such as HIV. 

9.3 Final Word 

Recent developments have made the last 10 years an increasingly exciting time to 
be studying control theory. In particular, the advent of interior-point algorithms 
for semidefinite programming has made a fundamental shift in how research is con- 
ducted. Instead of asking whether we can solve a problem numerically, it has become 
commonplace to instead ask whether the question can be reformulated as a convex 
optimization problem. Thus the very definition of a solution has become linked with 
the general availability of efficient numerical algorithms. This interaction between 
control theory and computer science has led to an ability to quickly analyze systems 
which a generation ago would perhaps have been considered prohibitively complex. 
Furthermore, as the definition of solution continues to evolve, new opportunities will 
arise for adventurous researchers to find ways to address problems which common 
sense might now classify as being out of reach. We note that such enthusiasm must 
be tempered with caution, however, lest mathematical rigor be sacrificed in the pro- 
cess. As to our own work, we note that none of the results presented would have 
been possible without the solid theoretical underpinning of computational complex- 
ity, convex optimization, real algebraic geometry, functional analysis, operator theory, 
Lyapunov theory, and the input-output framework. 
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Additional Notation: Denote the complete metric space 

K := {x e C[-r, oo) : x{9) = (p{9) for 9 E [-r, 0], sup \\x{t) ||e~"* < oo}, 

t>-T 

which has the following metric. 

d{x,y)v^ = sup||x(t) -y(t)||e~°* 

t>~T 

Define Cr to be the space of continuous functions defined on [— r, 0] with norm 

\\x\\cr = sup ||a;(t)||2. 

te[-T,o] 

For a given functional f : Cr x IR^ — > ffi", let A be defined by 

{Ax){t) = 0(0) + [ f{xs, s)ds for allt > 
Jo 

and (Ax)(t) = (j){t) for t G [-r, 0). 

Definition 107. We say that a functional f : CrX ffi^ — > ffi" satisfies Assumpt 
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• There exists a Ki > such that 

\\f{x,t)- f{y,t)\\2 < Ki\\x-y\\c, for aUx,yeCr,t> 

• There exists a K2 > such that 

11/(0, t) II <i^2 forallt>0 

• f{x,t) is jointly continuous in x and t. i.e. for every {x,t) and e > 0, there 
exists a r] > such that 

Ik - y\\cr + \\t -s\\<V =^ \\f{x, t) - f{y, s)\\ < e. 

Definition 108. Given a functional f : Cr x K"*" — > IR", we say that a function 
X e C[—T, 00) is a solution to Problem 1 with initial condition (f) & Cr if x is 
differentiable for t >0, x{t) — for t e [— r, 0] and 

x{t)^f{xt,t) forallt>0 

Results: 

Lemma 109. If f : Cr x IR"^ — > satisfies Assumptions 1, and x is a continuous 
function, then f{xt,t) is a continuous function in t. 

Proof. If / : X R+ M."- satisfies Assumptions 1, then for any ti, e > 0, there 
exists a 7^1 > such that 

\\xti - Xt^Wc, + \\ti - 12\\ < Vi ^ \\f{xt^:h) - f{xt2,t2)\\ < e. 

Now if x{t) is a continuous function of t, then for any ti > 0, x{t) is uniformly 
continuous on the interval It^ := [max{— r, ti — r — .1}, ti + .1]. Hence, for any 62 > 0, 
there exists a 772 > such that for Si, S2 G hi, we have that 

\si-S2\<r]2 ^ ||a;(si) - a;(s2)||2 < £2- 



Ill 



Now for a given ti > and e > 0, let r/i be defined as above. Let €2 = 771/2 define 772- 
Then if 77 = min{.l, 772, 771/2}, we have that |ti — ^2! < 77 impfies that 

Ikti - ^t^Wcr = sup \\xt^{9) - xt2{e)\\2 

oe[-T,o] 

= sup ||a;(ti + ^) -a;(t2 + ^)||2 < £2 = 771/2. 
ee[-T,o] 

This holds since ||(ti + ^) - (^2 + ^)|| = Pi-^2|| < 772 means ||a;(ti + ^) - x(t2 + ^)||2 < 
62 since ti + 6 e for 9 e [-r, 0] and t2 + 9 e for ||ti - 12\\ < .1, 9 e [-r, 0] and 
^2 > 0. Therefore we have that 

Iktl - Xt2\\Cr + 11^1 - ^2|| < 7/1/2 + 7/1/2 = 771. 

This implies that 

\\f{xt,M)- f{.Xt,M\\<^- 
Thus we have continuity of f{xt,t). m 



Lemma 110. Suppose f : Cr x — >■ M" satisfies Assumptions 1, then A : — >• V^. 
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Proof. Suppose x G V^. Let y = Ax. Then y{t) = 4>{t) for t e [— r, 0], y is 
continuous, and the foUowing holds for t > 0. 



< 



< 



|y(i)||2= 110(0)+ / f{Xs,s)ds\\2 

Jo 

10(0)112 + 11 / f{Xs,s)ds\\2 

Jo 

10(0)112+ / \\fiXs,s)\\2ds 

Jo 

10(0)112+ / \\f{xs,s)-f{0,s) + f{0,s)\\2ds 
Jo 

10(0)112+ / \\f(xs,s)-f(0,s)h + \\f(0,s)hds 
Jo 

10(0) II2+ / Ki\\xs\\cr + K2ds 
Jo 

10(0)112 + i^i / sup \\xs{9)\\2ds + K2t 
Jo ee[-T,o] 

10(0)112 + i^i / sup \\x{s + e)\\2ds + K2t 

Jo 0&{-T,0\ 



< 



< 



Now, since x e Va, there exists some c > such that ||a;(t)||2 < ce"* for all t > —r. 
Therefore, sup5,g[_^ Qj||a;(t + ^)|| < ce"* for all t > 0. Therefore, we have the following 
for t > 0. 

||2/(t)||2 < ||0(O)||2 + i^i / sup \\x{s + e)\\2ds + K2t 

Jo 0el-T,o] 

< ||0(O)||2 + i^i / ce"'ds + K2t 
Jo 

= 110(0)112 + ^(e"*-l) + X2i 
a 
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Thus 

sup||y(t)||2e-"* < sup ("110(0)1126-"* + ^(1 - e-"*) + i^2te-"* 

<IWO)lb + ^ + ^ = ei. 

a a 

Now let C2 = supgg[_^o] 11^(^)11 c = max{ci,C2}. Then supj>_^|||/(t)||2e-"* < c. 
Thus 2/ e Vq. ■ 



Lemma 111. Suppose f : CrX IR"^ — > K" satisfies Assumptions 1, and Ki < a. Then 
A is a contraction on V^. 



Proof. Suppose x, y G 14- Then we have the following for i > 0. 

\\Kx{t) - Ky{t)h = II / f{xs, s) - fiVs, s)ds\\2 
Jo 

< / \\fixs,s) - f{ys,s)\\2ds 
Jo 

t 

Ki\\xs - VsWcrds 

^ Ki sup 11X5(6') - 2/5(6') 1 1 2^5 

Jo 6»e[-T,o] 

^Ki[ sup ||x(s + ^) -y(s + ^)||2cis 

Jo 6»e[-T,o] 

^Ki [ sup ||a;(^)-y(^)||20?s 
Jo ee[s-T,s] 



Now recall that d{x,y)va — sup(>_^||x(t) — y(t)||e Therefore, ||a;(t) — t/(t) II2 < 
d{x,y)v^e'^^ for all t > -r. Thus supge[t-r,t] Ik(^) - 2/(^)l|2 < rf(a;,2/)e"* for aU t > 0. 
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Thus we have the following for all t > 0. 



||Ax(t) - Ay{t)\\2 <Ki [ sup \\x{e) - yie)\\2ds 

Jo ee[s-T,s] 



a 

Therefore 



<K, [ d{x,y)v^e"'ds 
Jo 

'^\d{x,y)vAe'''-l) 



d{Ax,Ay)v^ = sup||Ax(t) - A2/(t)||2e 



-at 



t>~T 



-at 



= sup||Ax(t) - Ay(t)||2e- 

t>0 

K 

< sup — d(x,|/)y^(l - e""*) 

< —dix,y)v^ < d{x,y)v^ 

a 



Therefore A is a contraction on V^. 



Lemma 112 (Existence). Suppose f satisfies Assumptions 1, x & Va, and x = Ax. 

Then x is a solution of Problem 1. i.e. x is differentiate , xit) = (j){t) for t G [— r, 0] 
and 

x{t) = f{xt,t) forallt>0. 

Proof. Since x G V^, x is continuous and x{t) = (pit) for t G [— r, 0]. Furthermore, 
since x = Ax, we have that 

x{t) = <j){0)+ [ f{x,,s)ds. 
Jo 

Since x is continuous and / satisfies Assumptions 1, by Lemma 11091 we have that 
f{xs,s) is a continuous and integrable function on [0,t]. Now, since x(t) — x(0) = 
Jo fi^s, s)ds, we have by the fundamental theorem of Calculus(vl) that x{t) — x(0) 
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is differentiable and 

x{t)^ f{xt,t). 



Lemma 113 (Uniqueness). Suppose f satisfies Assumptions 1, then any solution 
to Problem 1 is unique. 

Proof. Suppose x and y are solutions to Problem 1. Define p as follows for t > 0. 

p{t)= sup ||a;(^)-y(^)||2 
0e[t-T,t] 

= sup \\x{e)-ym2 
e&[t-T,t],e>Q 



= sup 11/ f{xs,s) - f{ys,s)ds\\2 
6>e[t-r,t],e>o Jo 

< sup / \\f{xs,s) - f{ys,s)\\2ds 

< sup Ki I \\xs - ysWcrds 
ee[t-T,t],e>o Jo 

re 

— sup Ki / sup ||a;(a;) — |/(ci;)||2(is 
ee[t-T,t],e>o Jo uje[s-T,s] 



sup Ki / p{s)ds 
ee[t-T,t],e>o Jo 



Now let q{t) = JoP{s)ds. Then ^(0) = and q{t) = p{t) > for all t >. Therefore, q 
is non-negative and monotonically increasing. Thus we have the following. 



r9 

q{t) < sup Ki / p{s)ds 

e&[t-T,t],e>o Jo 

< sup Kiq{e) = Kiq{t) 
ee[t-T,t],e>o 
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Therefore, we have that q{t) — Kiq{t) < for all t > 0. Which implies the following 
for g{t) = q{t)e-^'\ t > 0. 

m = I (g(t)e-^^*) = e-^^* m - KMt)) < 

Since g{0) = g(0) = and g{t) < for all t > 0, we have that g{t) < for all 
t > 0. However, g{t) < implies q{t) < 0, and so we have that q{t) = for all t > 0. 
Therefore, since q{t) = p{t) = for all t > and p{0) = 0, we have that p{t) = for 
all t > 0. This implies that x{t) = y{t) for all t > 0, which implies that x = y. Thus 
any solution to problem 1 is unique. ■ 

Theorem 114. Suppose a functional f : Cr x — M" satisfies the following. 

• There exists a Ki > such that 

\\fix,t) - fiy,t)\\2 < Ki\\x - y\\c^ for all x,y eCr,t> 0. 

• There exists a K2 > such that 

\\f{0,t)\\<K2 forallt>(}. 

• f{x,t) is jointly continuous in x and t. i.e. for every and e > 0, there 
exists a rj > such that 

\\x - y\\cr + \\t - 4 <V ^ \\fix,t) - f{y,s)\\ <e. 

Then for any cf) E Cr, there exists a unique x G C[— r, 00) such that x is difjerentiable 
for t > 0, x{t) = (j){t) for t G [-r, 0] and 

x{t) = f{xt,t) forallt>0. 

Proof. We have already shown by Lemmas IllUI and II 111 that A, as defined by /, is 
a contraction on for any a > K. Therefore, there exists some a > K, x E such 
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that X = Ax. Therefore, by Lemma [1121 we have that x is a solution. By Lemma ril3[ 
we have that this solution is unique. ■ 

Lemma 115. Let 

f(x, t) := J2 ^j^ii - ^j) + / M0)xit - e)d9, 

j = l J-r 

where A{9) is bounded on [— r, 0]. Then there exists some K > such that 

\\f{x,t)-f{y,t)h<K\\x-y\\c^. 

Proof. For A G M"^"^, let cx(v4) denote the maximum singular value of A. Then we 
have the following. 



\\f{x,t)-f{y,t)\\2 



A{9){x{t-9)-y{t-9))d9\\, 



= lE^i(a;(t-T-,)-y(t-r,))+ / 

j = l J-r 

<Y^\\A,{x{t-T^)-y{t-TM,+ / \\A{9){x{t - 9) - y{t ~ 9))hd9 

.7 = 1 -^-^ 



N 



<Y^a{A,)\\x{t-r,)-y{t-T,)h+ I a{A{9))\\x{t - 9) ~ y{t - 9)hd9 
i=i -^-^ 

<Y^a{A^)\\x-y\\c^+ / cx{A{9))d9\\x - y\\c^ 
,=1 -^-^ 

N ^ 

/ a{A{9))d9 

.7=1 -^-^ J 





N 



\x - y\\Cr 
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Lemma 116. M G ^mN ^/ ^'^'^ o'^^?/ ^/ ^^ere exists some matrix Q G 
where Uz = ("^'^) snc/i t/iat Q > and i/ie following holds. 

M{x) = {Z^[x]f QZ-[x] 

Proof. Since M G Eg, we know that there exist Gi G ]R"^"[x] for i = 1 . . .m such 
that 

m 

M{x)=J2G^{xfG,{x) 

i=l 

Now suppose that there exists some i' and io, jo such that element [Gi'jio.jo of is 
of degree d > d. Then, since Mi^^i^^{x) = Y.'iLi Y,k[Gi\k,ioi^)'^^ we have that Mi^^i^, is 
of at least degree 2d. This is because a finite sum of squares of M[x] is of degree 2d, 
where d is the maximum degree of the squared elements. However, since M G by 
assumption, we have a contradiction. Therefore Gi G M2^"[x]. Now, for any element 
Gi G there exists a 5 G M«x"('^-) where 4 is the length of Zd[x] such that 

Gi{x) = BZ^[x]. Therefore we have that 

m 

M{x) = J2 [Z-AAYb^BZ-M = [ZAxfQZAx], 

i=l 

where Q = J2T=i B^B > 0. ■ 
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Lemma 117. M ^T^g if and only if y^M{x)y e E^. 

Proof. Suppose f{x) = y^M{x)y G S,. Then f{x) = ET=l9^{x,yy = 

Y^^ii^ii^V y)'^ where the bi are some vectors of functions. This follows since the gi 
must be homogeneous of degree 1 in y. Therefore, we have the following. 

m 
i=l 

Thus M{x) = bi{x)bi{xf. Therefore M{x) e E,. 

(^) Now Suppose M e E,. Then for some Gi{x) e R"^"[x] for i = 1 . . . m, we 
have that f{x) = y'^M{x)y = J2Ziy^^i(^)^i(^)y = YT=\9i{x,yY gi{x,y), where 
= Gi{x)y. Therefore, / G E^. ■ 



Appendix C 
Appendix to Chapter 



5 



Lemma 118. < fi{x)x < (3x^ where (3 



po 



Proof. Recall fi{y) = min{e^J' - 1, e^^" - l}.Let 

efy-l 
ci{y) = . 

y 

We show that ci{y) > for all y. 



ci{y) 



y2 



Ciiy) > for all y is and only if C2 := Ci{y)y'^ > for all y. 



a 



C2iy) = i-ye-y. 

T 

Thus C2{y) < for all ?/ < and C2{y) > for all ?/ > 0, therefore C2 has a global 
minimum at y = 0. Since 02(0) = 0, we conclude that C2{y) > for all y and thus 
Ci{y) > for all y. Since Ci is monotone increasing, we have the following for all 
y < Po- 

e^y -I ^ efP" - l 

y ~ Po ' 
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Thus for y < po- 

(e^^ - l)y < f3y\ 
Furthermore, hmj^^_oo Ci (y) = therefore, Ci{y) > for all y, thus 

{ery - l)y > 0. 

Therefore, by the definition of /i, we have that < fi{x)x < (3x'^. ■ 

Lemma 119. Let z = A^y with y G 1^2? then limt_^oo z{t) = 0. 
Proof. Let v = z = Ay. Suppose that T2 > Ti > and let H = Pt^ — Pti- Then 

/•T2 

\\Hv\\l = / z{tfdt 

/•T2 /•T2 

<(3 z{t)y{t) dt - 13 I z{t)z{t)dt 

Jti Jti 

= f3{Hv,Hy)~^{z{T2f-z{T,f) 
< mvMHyh - ^{z{T,f - z{T,f) 

Hence 

z{T2f - z{Tif < 2\\HvU\Hyh - '^\\Hv\\l 
<2\\Hvh\\Hyh 

By Lemma |2ni f G L2. Since and ||y|| exist, we can use the Cauchy criterion 
and the above inequality to establish that for any 5 > 0, there exists a such that 
T2 > Ti > Ts implies {z{T2Y — z(TiY) < 6. It is shown in Lemma 11221 that this 
implies that for any infinite increasing sequence {Ti}, {z(Ti)'^} is a Cauchy sequence 
and therefore converges to a limit. Since z is continuous, this implies that z{t) 
also converges to a limit, Zoo- Since y G W2, we have limt-,ooy{t) = yoo = 0. Recall 
/c(a, b) = fi{b) at points such that a > —po or 6 > 0. Suppose Zoo 7^ 0. If Zoo < 0, then 
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Voo- Zoo> and /^(a, b) = fi{b) in some neighborhood of {z^o, Voo - -2oo)- If Zoo > 0, 
then ^oo > > —po and fc{a, b) = fi{b) in some neighborhood of {zoo, Voo — Zoo)- Since 
/i is continuous, we have hmj^oo z{t) = hm^^oo fc{z(t),y(t) - z{t)) = /i(?/oo - ^oo) = 
-Zoo)- By inspection of the function /i, we see that Zoo 7^ imphes that i has 
a nonzero hmit. However, since i G L2, it cannot have a nonzero hmit. Thus we 
conclude by condradiction that Zoo = 0. m 

Lemma 120. Ifv = Ay with y G W2, then {v,y — v) > — /3|?/(0)p. 

Proof. Let z = A^f and define the variable r{t) = y{t) — z{t) and the set M = {t : 

z(t) > —po or r(t) > 0}, then 



Since y G W2, we have that y is absolutely continuous and thus r is absolutely 
continuous. Since r, z are absolutely continuous functions and since by Lemma EHl 
we have z{t) — > 0, we can partition the set M into the countable union of sequential 
disjoint intervals Uj-^iU-^/ where li = [Ta,i,Tb,i) with {Ta,i} , {Tb^i} C M+ and // = 
[Taj, 00). To see that the intervals are closed on the left, suppose Jj were open on 
the left. Then, since T^^j ^ M, z(Ta^i) = —pQ and r(Ta j) < 0. However, since r is 
continuous, r{Ta^i + ri) < for r] sufficiently small. Since r(t) < implies z(t) < 0, we 
have that z{Ta^i < —po and thus T^,, + rj ^ M for rj sufficiently small, which is a 
contradiction. Thus all the intervals are closed on the left. Similarly, one can show 
that all the intervals are open on the right. 

Now, consider time Tq > 0, where G M defines the start of one of the intervals 
described above. If z{Ta) > —po, then since z is continuous, z{Ta — Tj)> —po for all rj 
sufficiently small. Therefore Ta — t] E M for all rj sufficiently small. This contradicts 
the statement that the intervals are disjoint. We thus conclude z(Ta) = —po and 
consequently r{Ta) > by definition of M. Now suppose r{Ta) > 0. Since r is 
continuous, r(Ta — e) > and consequently — e G M for all e sufficiently small. 
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Figure C.l: Value of y, z at times Ta^i and T^,^i 



which contradicts the statement that the intervals are disjoint. Therefore we conclude 
r(T„) = if T„ 7^ 0. Then 

{v,y-v) = y^ [ f,{rit))fit)dt+ r fMt))r{t)dt 
f\{r{t))T{t)dt+ / h{T{t))r{t)dt 

We will assume that T^^i = 0. If Ta,i ^ 0, we have r(Ta^i) = and the proof becomes 
simpler. Since fi{r) is continuous in r and r{t) is absolutely continuous in time, by 
the substitution rule we have 

I fi{r)dr 

rr{Tt,i) r■r{n^^) 

= / fi{r)dr + y2 / fi{r)dr 

Jr{0) i^-^ Jo 

= / /i(r)rfr + V / /i(r)dr 

Jr{0) j Jo 

Since fi G sector[0, /?], f^^^*"''^ fi{r)dr > for any r(Tb^i) G M. The summation 
converges since it is bounded, increasing. Furthermore, since r(0) = y{0) — z{0) = y{0) 
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and I fi{r)dr\ < fi{y)y < Py"^ for any y, we have 

{v,y-v)= f Mr)dr + J2 r^""^ Mr)dr>-(3\ym' 
Jy(o) i Jo 



Theorem 121. For any initial condition xq G W2 with xo{—t) > —po, xo{9) > —po, 
there exists a f eW2 and T > such that A{xo, t) = B^{f, t + T) fort> 0. 

Proof. Recall the map is defined by the following dynamics for z — B^y. 
z{t) = for i < and for t > 

z{t)^U{z{t),y{t)-z{t-T)) 

Now suppose we let y{t) — f{t) + z{t — t) on a finite interval [0, T'] for some / e W2. 
The system is still well-posed and y e W2 if / £ W2 since the derivative of z is 
bounded. The dynamics are now given by z{t) — ior t < and the following for 
t > 

z{t)-fMt),m) 

Pcirt 1: The first part of the proof is to construct a, f EW2 that drives the state 
z{t) to z{T') — xo{0) for some T' > 0. Furthermore, for continuity with Part 2, we 
require that f{T') — —xo{—t). If Xo{—t) — and Xo{0) — 0, then we are done. 
Otherwise, there are 4 cases to consider. 

xo(-r) < 0,a;o(0) > First, let f{t) = et until Ti = -^ol-il) for e > 0. Let e be 
sufficiently large so that z{Ti) < xo{0). Such an e exists since z is bounded. Let 
f{t) = -xo{-t) > until time T' such that z{T') = Xo{0). Such T' exists since z{t) 
is now linearly increasing. 
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Xo{—t) > 0,a;o(0) < This case is handled similarly to the previous one. 

xo(-r) < 0,xo(0) < For this case, let f{t) = -et until time 71 = i. Then 
let f{t) — —1 until time T2 such that z{T2) — Xo{0) — 7 for some 7 > 0. Such 
time exists for any 7 < po — xo{0) since z{t) is linearly decreasing for z{t) > —po- 
Then let f{t) = xo(0) - 7 + \t for time = i(xo(-T) + 1). Make A sufficiently 
large so that z{T2 + Ai) < a;o(0). This is possible since z is bounded. Finally let 
f{t) = -Xo{-t) > until time T' when z{T') = a;o(0). Such T' exists since z{t) is 
now linearly increasing. 

Xo{—t) > 0,a;o(0) > or Xo(0) or xo{—r) — These cases are handled simi- 
larly to the previous one. 

Part 2: For time t e [T', T' + r], let f{t) = -xo{t-T'). We then have yiT' + r) = 
XQ{t-T')-z{T') = xo(-t)-Xo(-t) = 0. Let y{t) = Ofori > T'+r. Therefore y e W2 
and we conclude that the dynamics of the interconnection for time t E [T',T' + r] are 
given by z(T') = xo(0) 



z{t) ^Mz{t),y{t) + z{t-T)) 
^f,{z{t),^o{t-r)) 



(C.l) 
(C.2) 



And for t > T" + T, we have 



z{t) ^Uz{t),y{t) + z{t-T)) 

^f^{z{t),-z{t-T)) 



(C.3) 
(C.4) 



Therefore, we have that A{y,t + T') ^ B{xo,t). 
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Lemma 122. Suppose that for any 6 > 0, there exists a Ts such that T2 > Ti > Ts 
implies z{T2Y — z{TiY < 5- Then for any infinite, increasing sequence, {Ti], {z{TiY} 
is a Cauchy sequence. 

Proof. Proof by contradiction. Suppose that {z{Ti)'^} is not a Cauchy sequence. 
Then there exists an e > such that for any > 0, there exists i,j>N such that 
\ziT,y - ziT,y\ > e. 

Let 5 = f . By assumption there exists a Ts such that for all T2 > Ti > Ts, 

z{T2f - z{T,f < (C.5) 

Since {Tj} is strictly increasing, infinite, there exists a > such that T/v > Ts. 
Since {z(Tj)^} is not Cauchy, there exists ^i, ji > such that \z{Ti^Y — z{Tj^Y\ > e. 
Without loss of generality, we may assume ii > ji. We now have one of the two 
possibilities. 

. z{T,,r - z{T,,f > e 
. ziT,,y - ziT,,f < -e 

However, by Equation ()C.5|) . the first option is not possible since Tj > Tj > Tn > Ts. 
Therefore 2;(TjJ^ < z{Tj^Y ~ ^- Thus for all /c > ii, by ()C.5|) and since > Tj^ > 
Tj^ > T/v > T^, we have 

z{nf < z{T,,Y + < z{T,,f - e + I = z{T,,f - \ 

Now, let = i\. Again, since {z(Tj)^} is not Cauchy, there exists i^^H > H 
such that {zlTi^)"^ — z{Tj^y\ > e. Using the method above, for all k > 12 since 
Tfc > > > > T^, by ()(15jl we have 

z{nf < z{T,,f + I < z{T,,f - i < z{T,,f - 2'- 

Repeating n times, we find a in such that for all k > in, z(Tk)'^ < z{Tj^Y — n|. 
Since we can assume z{Tj^)'^ is finite, let n be sufficiently large and we have the 
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existence of an i such that that ziT^Y < 0, which is a contradiction. Thus we have 
that {^(Tj)^} is a Cauchy sequence. ■ 



Appendix D 



Appendix to Chapter [Zl 



Theorem 123. Suppose M : 
the following are equivalent 



S is a continuous matrix-valued function. Then 



1. There exists some e > such that the following holds for all x & Cr- 



x(0) 
x{e) 



M{e) 



x(0) 

x{e) 



de > eWxWl 



2. There exists some e' > and some continuous matrix-valued function T 
S" such that the following holds. 



T{d)dd = 



M{e) + 



T{d) 
-e'l 



> for all 9 E [-r, 0] 
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Proof. 



1) Suppose statement 2 is true, then 

T 



x(0) 

x{e) 



M{0) 



x(0) 

x{e) 



dO — e'^x\\\ 



a;(0) 



T{0) 
-e'l 



x{0) 



dO > 0. 



M{e) + 

(1 =^ 2) Suppose that statement 1 holds for some M. Write M as 

M{e) 

We first prove that M22{0) > el for all 9 e [— r, 0]. By statement 1, we have that 



'Mnie) Muie) 



i: 


x(0)" 


T r- 




x{9) 





Mn{9) Mu{9) 
Mu{9f M22{9)-eI 





x(0)" 




x{9) 



d9 > 0. 



Now suppose that M22{9) — el is not positive semidefinite for all 9 e [— r, 0]. Then 
there exists some xq G R" and 9i e [— r, 0] such that Xq{M22{9i) — eI)xo < 0. 
By continuity of M22, if ^1 = or 9i — — r, then there exists some 9[ G (— t, 0) 
such that Xq{M22{9'i) — eI)xo < 0. Thus assume 9i G (— r, 0). Now, since M; 



22 



is continuous, there exists some xi and 5 > where 9i + 5 < 0, 9i — 5 > —r 

and such that x{{M22{9) - el)xi < -1 for all 9 e [9i - S,9i + 6]. Then for l3 > 
max{l/(-^i - 6), l/(r + ^1 - 6)}, let 



x{9) = < 



(1 + (3{9 - {9i - 6)))xi 9e[9i-5- 1/(3, 9i - S\ 

xi 9e [9i -6,9i + 6] 

(1 - p{9 - {9i + S)))xi 9 e[9i + S,9i + 6 + 1//3] 

otherwise. 



Then x E Cr, x{0) = and \\x{9)\\ < \\xi\\ for all 9 e [-r, 0]. Now, since M22 is 
continuous, it is bounded on [— r, 0]. Therefore, there exists some 62 > such that 
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^22(0) — el < 62!. Then let P > 2e2\\xi\\'^/d and we have the following. 



x(0) 



M{e) 



x{e) 



dO — e\\x\ 



x{ef{M22{0) - el)x{e)d9 

-T 



xi {M22{9) - €l)xid9 



+ 



+ 



ei-5 



x{9f{M22{e)-eI)x{0)d0 



di-S-l/p 



x{ef{M22{e)-eI)x{0)d0 



'01+5 
< -25 + 62 



x{e)fde + e2 I 

01-5-1/13 J01+5 

< -2(5 + 2e2||xi||V/9 < S 



\x(e)\\^de 



Therefore, by contradiction, we have that M22{0) > el for all 6 G [— r, 0]. Now we 
define e' = e/2 and M22{0) = M22{0) - e'l > e'l. We now show that M22(6')"^ is 
continuous. We first note that M22(^)~^ is bounded, since 

M22(^) >e'I ^ / > e'M22{9)-^ M22(^)"' < j,I 

Now since M22 is continuous, for any /? > 0, there exists a (5 > such that 

1^1 - ^2! < ^ 11^22(^1) - ^22(^2) II < P 
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Therefore, for any j3' > 0, let S be defined as above for (3 = Then \9i — < S 

imphes 

\\M22{e,)-' - M22{02)-'\\ 

= ||M22(^l)"'M22(^2)M22(^2)"' " M22(^l)"'M22(^l)M22(^2)"i 
= ||M22(^l)-' (M22(^2) - M22(^l)) M22(^2)"i 

< ||M22(^l)-i||M22(^2) - M22(^l)||||M22(^2)-i < ^11^22(^2) - M22(^l)|| < (3'. 

Therefore M22(^)~^ is continuous. We now prove statement 2 by construction. Sup- 
pose M satisfies statement 1. Let 

r(^) = To - {Mn{e) - Mu{e)M22{0)Mu{ef). 

Here 

1 /"^ 

To = - y (Mn(^) - M,2{e)M^^\e)Mu{ef)de. 

Then we have that T is continuous and 



T{0)de = tTo - tTq = 0. 



This imphes that T e fl. We now prove that Tq > 0. For any vector zq G R", 
suppose 2; is a continuous function such that z{0) — {I + M22{0)~^Mi2{0)'^)zo. Then 
let x{9) = z{9) - M22{0)''^Mi2{9)'^zo. Then x is continuous, x{0) = zo and by 
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T p 




x{e) 









T p 








_z{e)_ 









de 




x{e) 






T 


o" 




{Of I 





statement 1 we have the following. 

^ Mn(e) Mu{e) 
Muief M22{e) 

I 

-M22{e)-^M^2{of I 

Mu{e) - M^2{e)Mi^\e)M,2{ef o 
M22{e) 

J Mii{e) - Mu{e)M22io)Mu{efde)zo 



+ / z{9fM22iO)z{e)d0 

-0 



c 




T 


'Mu{9) 




z{9) 









zo 












_z{e)_ 



de 



de 



^z'^Tozo + j z(efM22(e)z(e)de>e'\ 



x\ 



We now show that this imphes that Tq > 0. Suppose there exists some y such that 
y^Toy < 0. Then there exists some zq such that zoTqZq — —1. Now let a > l/r and 



z{e)^ 



(/ + M22(0)-^Mi2(0)^)^o(l + aO) ee [-1/a, 0] 
otherwise. 



Then z is continuous, z{0) = (/ + M22{0)-^Mi2{Of)zo and \\z{e)f < \\z{0)f for all 
e e [-r,0]. Recall that M22(^) < (e2 + e')I = e^I. Let a > 2e3||^(0)2|| and then we 
have the following. 

z{efM22{e)z{e)de < -i + es / \\z{e)f 

■T J-l/a 



< -l + e3||^(0)||Va< 
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However, this contradicts the previous relationship. Therefore, we have by contradic- 
tion that To > 0. Now by using the invertibihty of M22{0) = Msal^) - e'l > e'l and 
the Schur complement transformation, we have that statement 2 is equivalent to the 
following for all 9 e [— r, 0] . 

M22{0) > 

Mu{9) + T{e) - Mi2{9)M22{0)-^Mu{9f > 
We have already proven the first condition. Finally, we have the following. 

Mu{9) + T{9) - Mu{9)M22{9)-^Mu{9f = Tq > 
Thus we have shown that statement 2 is true. ■ 



Lemma 124. Let M : R i— > S^" be a continuous matrix-valued function. Then the 
following are equivalent. 



1. There exists an e > such that the following holds for all x E Cr. 



x{0) 


T 


x{0) 




x{-t) 


M{9) 


x{-t) 




x{9) 




x{9) 





2. There exists some e' > and a continuous matrix valued function T : 
such that the following holds. 



j2n 



J T{9)d9 = 
M{9) + 



T{9) 
-e'l 



> for all 9 e [-r, 0] 
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Proof. (2 =^ 1) Suppose there exists some function T & Sq such that 

>0 for all ^ e [-T,0]. 



M(e) 

Then we have the following. 



T{e) 

-e'l 



x{0) 


T 


x{0) 


x{-t) 


M{e) 


x{-t) 


x{e) 




x{e) 




-1 T 





dO — e'\\x\\1 



a;(0) 
x{-t) 
x{d) 



M{e) + 



T{e) 

-e'l 



x{Q) 
x{-t) 
x{9) 



de>o 



(1 =^ 2) Suppose that statement 1 holds for some M. Write M as 

M{e) 



' Mu{9) Mi2{9) 
Mi2{0f M22{e)_ 



where M22 : K ^ S". We first prove that M22{9) > el for all 9 e [-t,0]. By 
statement 1, we have that 



/: 



a;(0) 
x{-t) 
x{9) 



Mn{9) Mu{9) 
Mi2{9f M22{9)-eI 



x(0) 
x{-t) 
x{9) 



d9 > 0. 



Now suppose that M22{9) — el is not positive semidefinite for all 9 e [— t, 0]. Then 
there exists some Xq and 9i e [— r, 0] such that (1/22(^1) — ^I)xq < 0. By 
continuity of M22, if ^1 = or 9i — — r, then there exists some 9[ E (— t, 0) 
such that XQ{M22i9[) — eI)xo < 0. Thus assume 9i G (— r, 0). Now, since M22 
is continuous, there exists some Xi and 6 > where 9i + 6 < 0, 9i — 6 > — r 
and such that xJ{M22{9) - el)xi < -1 ior 9 e [9i - 6,9i + S]. Then for p > 
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max{l/(-^i -5),l/(r + ^i -5)}, let 



x{e) 



(5{e -{9i-d- i/(3))xi ee[ei-d- i/p, - 5] 

xi ee [61 -5,61 + 5] 

(1 - p{9 - (^1 + 6)))xi 9 e[e, + S,9i + S+ l/(5\ 

otherwise. 



Then x e C^, x{-t) = x(0) = and \\x{e)f < \\xif for all 6 e [-t,0]. Now, 
since M22 is continuous, it is bounded on [— r, 0] . Therefore, there exists some £2 > 
such that M22i0) - el < 62! for 9 e [-r, 0]. Let /3 > 2e2||a:i|p/(5 and we have the 
following. 



a;(0) 


T 


x(Q) 




x{-t) 


M{e) 


x{-t) 


d9-e\\x\\^ 


x{9) 




x{9) 





= / x{9f{M22{9)-eI)x{9)d9 



= / xl{M22{9)-eI)xid9+ / x{9f{M22{9)-eI)x{9)d9 



lei-s 

+ / x{9f{M22{9)-eI)x{9)d9 

fdi-5 i-ei+5+1/13 

<-26 + e2 \\x{9)\\^d9 + e2 

Jei-s-i/i3 Jei+s 

< -2S + 2€2\\xif / f3 < -S 



\x{9)\\^d9 



Therefore, by contradiction, we have that M22{9) > el for all 9 G [— r, 0]. Now we 
define e' = e/2 and M22{9) = M22{9) - e'l > e'l. We now show that M22(^)"^ is 
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continuous. We first note that M22(^) ^ is bounded, since 

M22{e) > e'l 

=^ / > e'M22 W 

Now since M22 is continuous, for any /3 > 0, there exists a, 5 > such that 

1^1 -021 <S^ \\M22iOl) - M22(^2)|| < p. 

Therefore, for any P' > 0, let S be defined as above for /3 = Then |^i — ^2] < 

imphes 

||M22(^l)-' - M22(^2)~l 

= ||M22(^l)-'M22(^2)M22(^2)"' - M22(^l)-'M22(^l)M22(^2)"i 
= ||M22(^l)"' (^22(^2) -M22(^l)) M22(^2)~i 



< ||M22(^l)-i||M22(^2) -M22(^l)||||M22(^2)-1 

< 411^22(^2) -M22(^l)||</?'. 

Therefore M22(^)"^ is continuous. 

We now prove statement 2 by construction. Suppose M satisfies statement 1. Let 

T(e) = To - (Mn(e) - Mi2{e)M^^\e)Mu(ef) 

Where 



1 





To = ^ / (Mn(^) - M^2{0)M^^\e)M^2{0f)de 



-T 

Then we have that T is continuous and 



j T{0)de 



tTo - tTo = 
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Which imphes that T G ^2. We now show that Tq > 0. For any constant vector 

-iT 

Zq — Zi Z2 , suppose that 2; is a continuous function such that 



z{0)^zi + M22{0)~^Mu{0fzo 

z(-t) ^Z2 + M22(-Ty^Mi2(-Tfzo. 



Then, let x{9) = z{0) - M22{0)~^Mi2{0)'^ zq. Then x is continuous, x{0) x{-t) 
Zq and by statement 1 we have the following. 



a;(0) 


x\ 


-r) 


x{e) 






zo 




z{e)_ 








z{e)_ 



Mu{e) M,2{e) 



T 



x(0) 


x{- 


-r) 


x{e) 




T 







I 





d0 

Mn{e) Mu{e) 
Mi2{0f M22{e) 



Mu{e) - Mu{e)M22io)Mu{ef o 

M22{9) 









_z{e)_ 




Zq 




_z{e)_ 



de 



de 



/-O 

Mii{0) - Mi2{O)M22{O)Mi2{O)^d0)zo+ / z{9)^ M22{O)z{0)d9 

-T J —T 



^z^ToZo+ / z{9fM22{9)z{9)d9>e'\\x\ 



We now show that this implies that Tq > 0. Suppose there exists some y such that 

1 T 



y Toy < 0. Then there exists some zq such that zqToZq — —1. Now let zq 



Zl Z2 
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ci = ^1 + M22(0)-iMi2(0)^^o, C2 = ^2 + M22{-T)-^Mi2{-Tfzo, a > 2/t and 



ci{l + ae) ee[-i/a,o] 

C2(l-(e + T)a) e e[-T,-r + l/a] 
otherwise 



Then z is continuous, z{0) — ci — zi + M22(0) ^Mi2(0)^2;o, ^{—'t) — C2 — Z2 + 
M22(-T)-'^Mi2(-rfzo, and \\z{e)f < c = max{||ci||M|c2|p} for all 9 e [-t,0]. 
Recall that M22{0) < (^2 -\- e')I — e^I. Let a > le-^c and then we have 



^To^o + r z{BfM22{Q)z{Q)dQ < -1 + T \ 

J-T J-l/a 



< -1 + esc/a < --. 

This contradicts the previous statement. Thus we have by contradiction that 
To > 0. Now by using the invertibility of M22 = ^22 (^) — e'-^ ^ e'-^ and the Schur 
complement transformation, we have that statement 2 is equivalent to the following. 

M22(^) > 

Mn{0) + T{e) - M^2{e)M22{e)-^M^2{eY > o 

The first condition has already been proven. Finally, we have the following. 
Mui9) + T{9) - M^2{0)M22{0y^M^2{0f = Tq > 



Thus we have shown that statement 2 is true. 



Lemma 125. Suppose M is a matrix valued function which is continuous except 
possibly at points {Tj}^^^ where Ti G [— rx,0]. Then the following are equivalent. 
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1. The following holds for all x G C 



TK- 



TK 



M{9) 



x{0) 



> 



2. The following holds for all x where x is continuous except possibly at points 



{-r.}f-^ 



fi=l 



f 

J -TK 



x{Q) 

x{e) 



M{e) 



x(0) 

x{e) 



> 



Proof. Clearly statement 2 implies statement 1. Now suppose statement 2 is false. 
Then there exists some piecewise continuous x , e > such that 



TK 



x{0) 

x{e) 



M{e) 



x(0) 

x{e) 



de < -e. 



Now let 



x{9) 



x{-n -^)+{x{-n + ^) -x{-n -^)mo + n +^)/2) 
[x{e) 



i = l,...,ir-l 
otherwise. 



Then x is continuous. Since x is piecewise continuous on [— rx,0], it is bounded on 
this interval. Now let c = maxgg[_^^^o] Then ||,x(^^)|p < c for all 9 G [— rfc,0]. 

Now since M is piecewise continuous on [— Tfe,0], there exists some e' > such that 
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M{9) < e'l for 9 e [— r^, 0]. Therefore we have the folfowing. 



£(0) 
x{e) 

K-l 



T 



M{e) 



£(0) 

x{e) 
+1//? 



x(0)' 



M(^) 



£(0) 



x(0) 



M(^) 



x(0) 



dd 



,1 ^-Ti-l//3 

i=l J-n-l/P 

< Vi + 2e\K - l){Ac) / (3 

< -e + 8e'{K -l)c/p 

< -e/2 

Which holds for /3 > {k-i)c ^ Thus statement 2 is false imphes statement 1 is false. 
Therefore statement 1 imphes statement 2. ■ 



Lemma 126. Suppose jS'j : R i— > S^", i = 1 . . . X are continuous symmetric matrix 
valued functions with domains [— Tj, — r^-i] where tk > Ti > Tj-i > tq = /or i — 
2 . . . K — 1. Then the following are equivalent. 



1. There exists an e > such that the following holds for all x & C 



■Tk ■ 



K 

1=1 



x(0) 

m 



s^{e) 



x(0) 

m 



dO > e\\x\\l 



2. There exists an e' > and continuous symmetric matrix valued functions, Ti 
R ^ such that 



s^{e) 



W) 

-e'l 



>0 fore e[-Ti,-Ti_i] i^l...K 



141 



Proof. (2 =^ 1) Suppose there exist continuous symmetric matrix valued functions, 
: M ^ S", such that 



Then 



Si(9) + 

K 



W) 

-e'l 



> i^l...K 



-Ti-l 



1 " -H 



K 



E 

i=l 

= E 



x(0) 

x{e) 



x(0) 

x{e) 



dO — e'WxWl 



r—n-i 


x(0)" 


s,{e) + 


'W) " 




x(0)" 


' -n 


x{e)_ 


-e7 







> 0. 



(1 =^ 2) Suppose that statement 1 holds for some Si. Write Si as 



We first prove that M22i{0) > el for all 9 e [— Tj,— Tj-i], 
statement 1, we have that 



1,...,X. By 



K 





'x{0j 




'-n 


_x{e)_ 







'x{0) 




_x{e)_ 



d9 > 0. 



_Mui{ef M22i(e)-el_ 

Now suppose that M22i{0) — el is not positive semidefinite for all 9 e [— Tj, — Tj_i]. 
Then there exists some xq e R" and 9i e [— Tj, — Ti_i] such that (M22i(6'i) — 
e/)a;o < 0. By continuity of M22j, if Oi = —Ti or 9i = — Tj_i, then there exists some 

9[ G {—Ti, —Ti-i) such that (M22i(^'i) — e/).xo < 0. Thus assume 9i G (— r^, — rj_i). 
Now, since M22i is continuous, there exists some Xi and 5 > where 9i + 6 < — ri_i, 
^1 - 5 > -Tj and such that xJ{M22i{9) - el)xi < -1 for ^ G [^i - 6, 9i + 6]. Then for 
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/3 > max{l/(-Ti -01- S), l/in + 81- S)}, let 



x{e) = < 



(5{e -{Oi-s- i/p))xi ee[ei-s- i/p, - s] 

xi ee [61 -5,61 + 5] 

(1 - p{9 - (^1 + 5)))xi 9 e[e, + S,9i + S + 1//3] 

otherwise. 



Then x e C^-^, x{0) — and < for 9 e [— tx,0]. Now, since every 

M22i is continuous, they are bounded on [— Tj,— rj_i]. Therefore, there exists some 
62 > such that M22i{9) - el < 62! for 9 e [-Ti,-Ti_i], i = 1,...,K. Then let 
P > 2e2||xi|p/5 and we have the following. 



K 
.7=1 



x{0) 
x{9) 



S,{9) 



a;(0) 
x{9) 



d9 — e\\x\ 



7=1 -^""i 



x{9f{M22j{9) - el)x{9)d9 



/ x^{M22i{9) - el)xid9 + I x{9f{M22i{9) - el)x{9)d9 



Jei-5-i/p 

f6li+(5+l//3 

+ / x{9f{M22i{9) - el)x{9)d9 

C01-5 1-91+5+1/13 

\2jn , , / Il™/Z)\ll2 



/ 

< -26 + €2 



\\x{9)\\'d9 + e2 

101-5-1/13 Jdi+5 

< -25 + 2e2||xi||V/3 < -5 



\x{9)\yd9 



Therefore, by contradiction, we have that M22i{d) > el for all 9 G [— r^, — ri_i] and 
i = 1,...,K. Now we define e' = e/2 and M22i{9) = M22i{9) ~ e'l > e'l. We now 
show that M22i{9)~^ is continuous. We first note that M22i(^)^^ is bounded, since 



M22m > e'l 

^ / > eM22i{9)-' 

^ M22i{9y' < h. 
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Now since M22j is continuous, for any /3 > 0, there exists a 6 > such that 

\e, -e2\<6^ \\M22^iOl) - M22i(^2)|| < P- 

Therefore, for any f3' > 0, let 6 be defined as above for /3 = /?'e'^. Then \6i — < 6 
imphes the following. 

= ||M22.(^^l)"'M22.(^^2)M22^(^2)"' -M22.(^^l)"'M22^(^l)M22^(^2)~i 
= ||M22.(^l)"' (M22^{02) " M22.(^l)) M22^(^^2)'1 



'2211(72 I 



< ||M22.(^^l)-i||M22.(^2)-M22^(^l)||||M2 '''^ 

< 4 11^22.(^2) -M22^(^i) II </3' 



e'2 



Therefore M22i{6) ^ is continuous. 

We now prove statement 2 by construction. Let 

Ti{e) = To - (Mmie) - Mu^{e)M22li0)Ml2^{0f), 

where 

K _ 

To = — V / ^ \Mmie) - M^2^{e)M22W)Ml2^{ef)de. 



i=l 'i 



Then we have that T is continuous and 



i=i 



We now show that Tq > 0. For any constant vector zq, let 2; be a continuous function 
except possibly at points {—Ti}f^^ and such that z{0) = (/ + M22i(0)^^Mi2i(0)"^)2;o, 
let x{9) = z{6) — M22i{0)^^ Mi2i{6Y zq for 6 E [— rj,— rj_i]. Then x is continuous 
except possibly at points {— Tj}^^^, x(0) = zq and by statement 1, and Lemma 
we have the following. 
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K 

E 



i=l 



r 


x(0)" 


T p 


' -n 







Muiief M22i{e) 









x{e) 



de 



K 

E 

i=l ■ 







T 


I 





T 


' Mni{e) 


M,2i{9) 


'-n 








I 




M,2i{ef 


M22i(e) 



I 






de 






M22ii0)-'MM9)^ I 









K 



1=1 



r—Ti-i 




T p 


l-n 


z{9\ 





d0 



Muiie) - Mui{9)M-l{e)Mui{9f 

M22i{e)_ 
l[Y, M,u{e)-M,2i{e)M^^]{e)M,2i{efde]zo+J2 ^z{ef M22^{e)z{e)de 





Zq 




_z{9)_ 



K 



1=1 ''-■^^ 
K 



ZqTqZq + 



i=l 



-Ti-l 



z{efM22i{0)z{e)de > e'\\x\ 



We now show that this imphes that Tq > 0. Suppose there exists some y such 
that y^Tou < 0. Then there exists some zq such that zqToZq = — 1. Now let a > 1/ri 
and 

'(7 + M22i(0)-^Mi2i(0)'-'>o(l + Q^^) ee [-l/a,0] 
otherwise 



Then z is continuous, ^(0) = (/ + M22i(0)-iMi2i(0)^)^o and \\z(e)f < \\z{0)f for 
all e e [-T, 0]. Recall that M22i{0) < (e2 + e')! = eg/. Let a > 2e3||^(0)2|| and then 
we have 



K 



^qToZq + 



i=l 



J -l/a 



z{eyM22i{e)z{e)de<-i + €s I wz 



<-l + e3||^(0)||7a<--. 



But this is in contradiction to the previous relation. Thus wc have by contradiction 
that To > 0. Now by using the invertibility of M22i = M22i{0)—€.' I > e'l and the Schur 
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complement transformation, we have that statement 2 is equivalent to the following 
ioT i — 1, . . . , K. 



M22i{0) > 

Mmie) + W) - M^2iie)M22iie)-'Muiief > o 



9 e [-Ti, -Ti_i] 



We have already shown the first statement. Finally, we have the following for i 
1...K. 

Mum + W) - M^2i{e)M22m-'M^2i{ef = To > 

Thus we have shown that statement 2 is true. 



Lemma 127. Suppose {Mi}f^^ are continuous symmetric matrix valued functions 
with domains [—Ti, — Tj-i] and tk > Ti > Tj_i > tq — for i — 2 . . . K — 1. Then the 
following are equivalent. 

1. The following holds for all x e Ct-^- 



K 

E 



-Ti-l 



x{-ro) 


T 


x{-Tq) 


x{-tk) 


M0) 


x{-tk) 











d9>0 



2. The following holds for all x where x is continuous except possibly at points 



K 

E 



=1 " -'i 



x{-To) 


T 


x{-To) 






x{-n)+ 








x{-tk)^ 




x{-tk)^ 


x{e) 




x{e) 



de>o 
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Where x{t) denotes the left-handed limit and x{t)~^ denotes the right-handed 
limit. 



Proof. Clearly statement 2 implies statement 1. Now suppose statement 2 is false. 
Then there exists some piecewise continuous x , and e > such that 



K 



i=l 



x{-To) 


T 












Mi{e) 










x(e) 




x{e) 



de < -e. 



Now let (5 > maxi=i^...^;<:{2/(Ti — Ti_i)} and 



x{e) = < 



x{e) 



i = 1,...,X-1 
otherwise. 



Then x is continuous on [— £(0) = x(0)~ and £(— r^) = x{—Ti)^ for i — 
1, . . . ,K. Since x is piecewise continuous on [—tk, 0], it is bounded on this interval. 

Now let c = maxeg[_^^o] Then < c for all 6 G [— r,fc,0]. Now since 

M is piecewise continuous on [—Tk, 0], there exists some e' > such that M{9) < e'l 
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for e [— Tfc, 0]. Therefore we have the following. 



K 



-Ti-\ 



i=l " 





T 




x{-tk) 




x{-tk) 











d0 



K 



i=l " 'i 



x{-ro) 


T 


x{-Tq) 






x{-n)+ 




Mm 




x{-tk)^ 




x{-TKy 


x{e) 




x{e) 



de 



K-l 



1 J-n-i/f3 



x{-Tq) 

x{-ny 

Xi-TKY 

m 



x{-Tq) 

x{-T,y 

x{-tk)^ 
x{0) 

x(-ro)" 

x{-n)+ 

Xi-TKV 
X{9) 



K-l 

i=i J-n-i/fi 



K 



K 



\X[ 



x{-ny 

x{-tk)' 

x{e) 

x{-tM 



\de 



de 



m'+Y}\^{-ryr]+[\\x{ew+Y.\ 

j=Q J V j=0 

<Vi + e'{K - l)(2c + 2{K + l)c)/(5 

< -e + 2e'{K -1){K + 2)c/ (3 

< -e/2 

Which holds for P > {k-i){k+2)c ^ Thus statement 2 is false imphes statement 1 is 
false. Therefore statement 1 imphes statement 2. ■ 
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Lemma 128. Suppose Si : g"(^+2) ^j.^ continuous matrix valued functions 

with dom,ains [— Tj, — rj_i] for i = 1, . . . ,K where Tk > Ti > Ti_i > Tq — for 
i — 2, . . . , K — 1. Then the following are equivalent. 



1. There exists an e > such that the following holds for all x e C^^^ . 



K 

E 



i=l " 'i 





T 










s^{e) 




x{-tk) 




x{-tk) 









dO > €\\x\\2 



2. There exists an e' > and continuous matrix valued functions T^ : 
such that 



gn(K+l) 



W) 

-e7 



s^{e) + 

.•1 J —Ti 



>o 9 e[-Ti,-Ti.i], i^i...K 



1=1 " 'i 



Proof. (2 =^ 1) Suppose there exist continuous symmetric matrix valued functions, 
Ti : §"(-^+1), such that 



Si{e) + 

K 

E 



W) 

-e'l 



> i = l...K 



i=l 



-n-i 



Ti{e) = 0. 



Then 
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K 

E 

i=l 



-n-i 





T 




x{-To) 








Si{e) 




x{-tk) 




x{-tk) 


x{e) 




x{9) 



dO — e||x||2 



K 

E 

i=l 



x{-To) 

x{-tk) 

x{e) 



Si{e) - 



W) 

-e'l 



x{-tk) 

x{e) 



de > 0. 



(1 =^ 2) Suppose that statement 1 holds for some Si. Write Si as 

s(e)= ^'''^^^ ^'''^^^ 

M,,i{9f M22i{9) 



where M22i : M ^ Wc first prove that M22i{0) > el for all 6 e [-n, -Ti_i], 
i — 1, . . . , K. By statement 1, we have that 



K 

E 

i=l 



-\ T 



X[-To) 

x{-tk) 



Mi2i{0f M22i{e)-el 



X[-To) 

x{-tk] 



de > 0. 



Now suppose that M22i{0) — el is not positive semidefinite for all 9 e [— Tj, — Tj_i]. 
Then there exists some xq e R" and 9i e [— Tj, — r^-i] such that (M22i(6'i) — 
eI)xo < 0. By continuity of M22i, if Oi = —ti or 6i = —Ti-i, then there exists some 

9[ G (— Tj, — Tj-i) such that (M22i(^'i) — e/).xo < 0. Thus assume 9i G (— Tj, — rj_i). 
Now, since M22i is continuous, there exists some Xi and 5 > where 9i + 6 < — ri_i, 
^1 - 5 > -Tj and such that xJ{M22i{9) - el)xi < -1 for ^ G [^i - 6, 9i + 6]. Then for 
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/3 > max{l/(-Ti -01- S), l/in + 81- S)}, let 



x{e) 



(5{e -{Oi-s- i/p))xi ee[ei-s- i/p, - s] 

xi ee [61 -5,61 + 5] 

(1 - p{9 - (^1 + 5)))xi 9 e[e, + S,9i + S + 1//3] 

otherwise. 



Thenx eCr,x{-Ti) = for i = 0, . . . , fsT and \\x{e)f < ||xi f for all ^ G [-rx,0]. 
Now, since every M22i is continuous, each are bounded on [— r^, — rj_i]. Therefore, 
there exists some 62 > such that M22i{0)—el < €2! for 9 e [— t^, — rj_i], i = 1, . . . , K. 
Then let /3 > 2e2||2;i|p/5 and we have the following. 



K 

E 

i=l 





T 




Xi-To) 






S^{9) 




x{-tk) 




x{-tk) 


. . 




x{9) 



d9 — e\\x\ 



-n-i 



K 

J2 I x{9Y\M22i{9) - el)x{9)d9 
i=i -^-n 

/ x^{M22i{9)-eI)xid9+ / x{9f{M22i{9)-eI)x{9)d9 



f6»i+5+l//3 

+ / x{9f{M22i{9) - el)x{9)d9 

'ei+s 

9i-5 i-ei+5+i/p 

\\x{9)fd9 + e2 / M9)\\^d9 



I 

< -25 + 62 

< -25 + 2e2||xi||7/3 < -5 



2 



1 61+6 



Therefore, by contradiction, we have that M22i{9) > for all 9 G [— Tj,— rj_i], 
i^l,...,K. Now we define e' = e/2 and M22i{9) = M22i{9) - e'l > e'l. We now 
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show that M22i{0) ^ is continuous. We first note that M22i{&) ^ is bounded, since 

M22i{e) > e'l 

^ / > e'M22i{e)-^ 

M22i(0)-^ < 

Now since M22i is continuous, for any /3 > 0, there exists a 5 > such that 

1^1 -92\<5^ ||M22^(^l) - M22i{92)\\ < (5. 

Therefore, for any /3' > 0, let 5 be defined as above for (5 — f3'e'^. Then |^i — ^2] < S 
imphes the following. 

\\M22i{ei)-' - M22i(e2)~'\\ 

= ||M22i(^l)-'M22i(^2)M22,(^2)-' -M22i(^l)-^M22i(^l)M22,^ 
= \\M22^{e,)-' (M22r{e2) - M22^(^l)) M22»(^2)-i 



< ||M22^(^l)-i||M22^(^2) -M22i(^l)||||M22i(^2)-'| 

< 4 11^22,(^2) -M22^(^l) II </?' 

Therefore M22i(^)"^ is continuous. 

We now prove statement 2 by construction. Let 



Ti{e) = To - (Mni(^) - M^2i{e)M2^mMi2i{ef) 

Where 

To^ — Y^r^ \M,u{e) - M^2i{e)M-^MMi2i{ef)de 



Then we have that Ti is continuous and 



1=1 -^--^i 
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Now for any constant vector = zq ■ ■ ■ zk ? suppose that z is a continuous 
function except possibly at points {— Tj}^7^ such that 



Zi + M22ii-T,)-'M-_ 



12i\ 



-TiS^Zr 



ZO + M22l{-To)-'Mi2l{-Tofz, 



Then, let x{9) = z{9) — M22i{0)~^ Mi2i{9)'^ Zc for 6 G [— Tj, — rj_i]. Then x is continuous 
except possibly at points {-Ti}f_^^, x(-ro)" = z{-to)- -M22ii-roy^ Mi2i{~To)'^ z^ = 
Zq, x(-ri)+ = 2(-ri)+ - M22i{-'ri)~'^Mi2i{-Ti)'^Zc = ZiioT i = 1, . . . ,K and by state- 
ment 1 and Lemma fl27l we have the following. 
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K 
1=1 



K 

E 



-Ti-l 



X{-Ti)- 

x{-tk) 

x{e) 



K 



= E 



r—Ti-x 




T r- 


'-n 






r—Ti-i 




T r- 









Miu{0) Mi2i{e) 



I 



de 



x{-tk. 



^ r-n-1 



M22i{e) 
Muiie) - Mi2i{e)M22l{0)M,2i{efde)zc 










de 








/ 















Zc 

z{9) 



de 



K 



+E 



-Ti-l 



z{efM22i{e)z{e)de 



i=l " 'i 



K 



^ToZc + Y. 



z{ef M22i{e)z{d)de > e'\\x\\l 



We now show that this imphes that To > 0. Suppose there exists some y such 
that y^Tgy < 0. Then there exists some Zc such that ZcTqZc — —1. Now let a > 
2/ maxj||Ti — Ti_i|| and 



(-^0 + M22i(0)-^Mi2i(0)^Zc)(l + ae) ee [-1/a, 0] 
z{0) = l{z, + M22^{-n)-'M,2^{-r^fzc){l + a9) 6 G [-T,, -T, + 1 / a] i^l...K 
otherwise. 



Then z is continuous except at points {— r-j}j^^ , z{0) = Zq + M22i(0) ^Mi2i{0)^Zc, 
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z{-Tiy = Zi + M22i{-Ti)-^Mi2i{-Tifzc and \\z{e)\\^ < c for all 6 e [-r, 0] where 
c = max I max {\\zi + M22i{-Ti)-^ Mi2i{-Tif ZcW"} , \\zo + M22i(0)-'Mi2i(0)^^c|| | 

Recall that M22i{0) < (e2 + e')I — 63!. Let a > 2e3c{K + 1) and then we have 



z'^Tozo + J2 f ' z(efM22i{e)z{e)de 

i=l -^-^i 

^zlTozo+ f z{efM22i{e)z{e)de + Y. I ^^^'^^ z{efM22^{e)z{e)de 

/O K i—n+l/a 

ikwir+E^3 / wzm'de 
■l/a J-Ti 



< -1 + £3 



< -l + e3c{K + l)/a<-^. 

But this contradicts the previous relation. Thus we have by contradiction that 
To > 0. Now by using the invertibility of M22i = M22i{0) — e'J > e'l and the Schur 
complement transformation, we have that statement 2 is equivalent to the following 
for i = 1, . . . , /T. 

M22i{e)>Q ^ e [-Ti, -ri_i] 

Miu(^) + Ti{e) - Mui{e)M22i{e)-'Mui{ef > o ee [-n, -t,_i] 

We have already proven the first statement. Finally, we have the following. 

Muiie) + Ti{e) - M,2i{e)M22i{e)-'Mui{ef = To > o 

Thus we have shown that statement 2 is true. ■ 



Lemma 129. Suppose M : M? W^^^ is a matrix valued function which is contin- 
uous except possibly at points {n}^-^ where Ti < Ti-i for i = 1, . . . ,K and tq = 0. 
Then the following are equivalent. 
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1. The following holds for all x e Crj^- 

r.0 /-O 



x{eyM{e,uj)x{e)deduj > o 

TK J —TK 



2. The following holds for all x where x is continuous except possibly at points 

I x{9fM{0,uj)x{9)d0duj>O 

■Tur J —Tic 



Proof. Clearly statement 2 implies statement 1. Now suppose statement 2 is false. 
Then there exists some piecewise continuous a; , e > such that 





T I 



Vi= I / x{ey M{e,uj)x{uj)deduj <-e. 

-TK J —TK 



Now let 

x{Q) 



i = 1, ...,X-1 



x{ff) otherwise. 

Then x is continuous. Since x is piecewise continuous on [— tk, 0] it is bounded on this 
interval. Now let c = max0g[_^^^o] Then < cforall6' e [-r^jO]. Now 

since M is piecewise continuous on [— ri^,0], it is bounded on this interval, i.e. there 
exists some e' > such that M{6,u})z < e'max{|||/|p, for 9,u! G [— rft-,0]. 
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Therefore we have the following. 

/ x{efM{e,uj)x{uj)deduj 

-Tk J —Tk 

^-1 r-Ti+llH j—Tj+1/13 

^ + X] / / {x{0fM{9, u;)x{u;) - x{efM{9, u;)x{u;)) dOduj 

^-1 r-Ti+l/l3 r-Tj+l/P 

<Vi + J2 / {2e'c)deduj 

= -e + Ae'(K - lfc/(3 < -e/2 

Which holds for (5 > M^^zi)_£_ Thus statement 2 is false implies statement 1 is false. 
Therefore statement 1 imphes statement 2. ■ 



Lemma 130. Let M he a matrix valued function M : — > which is discontinuous 
only at points 9,u! — —Ti for i — 1, . . . , K — 1 where the Ti are increasing and tq — 0. 
Then M e H2 if and only if there exists some continuous matrix valued function 
R-.W^^ j^nXxnJf gy^^j^ ^^^^ ^ g ^+ following holds where li — [—Ti, —Ti^i], 

Ai — Ti — Tj-i. 



M{e,u) ^ Mij{e,u) for all 9 eh, ou e Ij 



R{e,u}) 



Rii{0,uj) 



Rik{0,uj) 
Rkk{(^,'^) 



Proof. (^) Define ^j(^) = ^^ + Ti_i^ and uji{uj) = ^t^ + r^-i^. Then ^i(-Tj) = 
-"Tk, Oi{-Ti_i) = 0, 9{9i) = - Tj_i and ^ = The same relation holds 
between cu and cui. Because M is piecewise continuous, Mij as defined above are 
continuous. Then for any x e C^-^, let Xi{9) = ^x — rj_ij. Then Xi G C^.^ and 
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we have the following. 



fO 



x{efM{e,uj)x{iu) 



TK -J -TK 

K 



«J=1 




x{efMij{e,uj)x{uj)deduj 



K rO rO 



E 



1 —TK -J —TK 



rO 



—TK ■J —TK 





T 


Xi{uj) 






R{e,uj) 




ddduj > 


XK{e) 




xxiuj) 





Thus R e implies M e . 

(^) Now suppose M G H2 ■ Then for any nK dimensional vector valued function 
mCr^,x{e)=[x^ief ■■■ XKi9fY,deRnem = x-x^{f-0 + r,.lf-')ioTeeI,. 
Then x is continuous except possibly at points {— Tj} and we have the following. 



^-0 

/ x{efR{e,uj)x{Lu)d0duj 

-TK J -TK 

/ / Xi{9i)'^Rij{6i,ujj)xj{ujj)d9idujj 

iJ=l-^-TK J-TK 

V /" /" s:{efMij{e,uj)x{uj)dedu} 

pO 

/ x{9fM{e,Lj)i{u;)d9du; 

■TK J -TK 



where M is as defined above. Since M is bounded and positive on a; G C^-^,, Lemma 
shows that M is also positive on the space of functions which are continuous except 
possibly at points {—Ti}^S[^. Therefore, we have that R G H2 ■ ■ 
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